-- Logs begin at Tue 2022-05-24 12:16:11 UTC, end at Tue 2022-05-24 13:55:24 UTC. -- May 24 12:50:29.330064 dv-cinder-843018-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 12:50:29.340763 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 12:50:29 2022] *** May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: nodename: dv-cinder-843018-2-iscsi May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: machine: x86_64 May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: clock source: unix May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: pcre jit disabled May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: detected number of CPU cores: 4 May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: current working directory: / May 24 12:50:29.343322 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: detected binary path: /usr/bin/uwsgi-core May 24 12:50:29.344042 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: your processes number limit is 47680 May 24 12:50:29.344042 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: your memory page size is 4096 bytes May 24 12:50:29.344042 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: detected max file descriptor number: 2048 May 24 12:50:29.344042 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: lock engine: pthread robust mutexes May 24 12:50:29.344042 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: thunder lock: enabled May 24 12:50:29.344042 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 12:50:29.344042 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 12:50:29.391416 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: Python main interpreter initialized at 0x556c6df659c0 May 24 12:50:29.391416 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: python threads support enabled May 24 12:50:29.391416 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: your server socket listen backlog is limited to 100 connections May 24 12:50:29.391416 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: your mercy for graceful operations on workers is 90 seconds May 24 12:50:29.391826 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: mapped 403077 bytes (393 KB) for 2 cores May 24 12:50:29.391826 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: *** Operational MODE: preforking *** May 24 12:50:29.392113 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: *** uWSGI is running in multiple interpreter mode *** May 24 12:50:29.392113 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: spawned uWSGI master process (pid: 103023) May 24 12:50:29.392312 dv-cinder-843018-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 12:50:29.393086 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: spawned uWSGI worker 1 (pid: 103026, cores: 1) May 24 12:50:29.394331 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: spawned uWSGI worker 2 (pid: 103027, cores: 1) May 24 12:50:29.394331 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 12:50:30.558835 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 12:50:30.561126 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 12:50:31.282582 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:50:31.282582 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: from cryptography.utils import int_from_bytes May 24 12:50:31.282582 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:50:31.282582 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: from cryptography.utils import int_from_bytes May 24 12:50:31.285499 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:50:31.285499 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: from cryptography.utils import int_from_bytes May 24 12:50:31.286397 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:50:31.286397 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: from cryptography.utils import int_from_bytes May 24 12:50:33.852723 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 12:50:33.853270 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 12:50:33.853368 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 12:50:33.853726 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 12:50:33.853809 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 12:50:33.853889 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 12:50:33.853973 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 12:50:33.854070 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 12:50:33.854339 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 12:50:33.854486 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.854603 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 12:50:33.854811 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.854997 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.855134 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.855326 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.855456 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.855653 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.855786 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.855983 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.856088 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.856314 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.856407 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.856630 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.856717 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.856955 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.857046 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.857273 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.857363 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.857590 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.857681 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.857852 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.857942 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-2-iscsi {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.858170 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.858254 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.858524 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-2-iscsi {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.858613 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.858850 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.858951 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.859157 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.859247 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.859462 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.859553 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.859782 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.859871 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.860088 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.860184 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.860413 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.860588 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.860728 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.861040 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.861239 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.861359 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.861557 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.861650 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.861871 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.861972 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.862187 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.862308 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.862554 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.862659 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.862874 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.862973 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.863188 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.863294 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.863511 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.863602 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.863873 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.864456 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.864688 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.864779 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-2-iscsi {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.865001 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.865130 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.865370 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.865475 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-2-iscsi {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.865689 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.865796 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.866032 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.866142 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.866360 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.866472 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.866733 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.866824 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.867058 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.867150 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.867386 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.867495 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.867697 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.867796 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.868023 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.868113 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.868338 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.868511 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.868660 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.868771 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.868983 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.869080 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.869284 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.869378 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.869595 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.869682 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.869905 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.869995 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.870216 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.870338 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.870552 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.870637 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.870861 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.870958 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.871114 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.871214 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.871423 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.871522 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.871705 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.871796 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.872020 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.872170 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.872346 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.872437 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.872607 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.872718 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.872861 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.872971 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.873182 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.873269 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.873464 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.873560 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.873787 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.873873 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.874101 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.874199 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.874435 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.874524 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.874746 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.874831 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.875055 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.875170 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.875363 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.875451 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.875670 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.875755 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.875975 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.876071 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.876285 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.876380 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.876594 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.876686 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.876913 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.877012 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.877221 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.877312 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.877540 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.877631 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.877849 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.877941 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.878172 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.878263 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.878504 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.878589 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.878843 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.878939 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.879428 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.879524 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.879737 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.879822 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.880057 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.880144 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.880377 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.880461 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.880683 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.880768 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.880991 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.881083 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.881295 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.881381 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.881602 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.881684 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.881913 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.881999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.882214 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.882325 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.882492 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.882577 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.882798 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.882901 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.883100 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.883196 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.883421 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.883559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.883713 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.883797 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.884016 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.884105 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.884322 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.884415 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.884623 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.884707 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.884928 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.885010 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.885233 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.885365 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.885539 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.885624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.885845 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.885938 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.886151 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.886247 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.886482 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.886568 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.886790 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.886886 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.887095 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.887187 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.887400 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.887485 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.887705 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.887796 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.888014 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.888099 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.888322 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.888406 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.888629 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.888721 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.888934 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.889031 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.889308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.889401 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.889550 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.889649 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.889854 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.889946 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.890159 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.890244 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.890497 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.890582 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.890810 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.890914 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.891115 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.891199 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.891429 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.891513 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.891736 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.891822 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.892041 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.892125 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.892354 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.892443 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.892655 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.892747 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.892967 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.893062 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.893264 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.893348 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.893574 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.893660 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.893879 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.893962 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.894184 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.894276 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.894515 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.894609 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.894820 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.894903 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.895148 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.895312 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.895454 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.895538 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.895758 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.895842 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.896061 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.896222 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.896368 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.896452 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.896672 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.896758 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.896983 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.897074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.897292 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.897377 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.897598 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.897682 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.897904 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.898000 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.898214 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.898320 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.898563 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:50:33.898648 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.898901 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.898988 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.899222 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.899352 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.899558 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.899645 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.899884 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.899974 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.900203 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.900287 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.900520 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.900604 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.900836 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.900921 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.901163 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.901248 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.901477 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.901569 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.901791 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.901877 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.902105 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.902200 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.902444 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.902547 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.902765 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.902851 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.903092 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.903217 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.903413 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.903511 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.903734 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.903819 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.904054 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.904138 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.904367 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.904461 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.904689 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.904784 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.905009 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.905101 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.905332 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.905428 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.905648 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.905734 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.905983 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.906074 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.906320 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.906420 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.906657 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.906741 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.906985 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.907078 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.907313 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.907422 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.907627 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.907722 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.907942 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.908034 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.908255 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.908348 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.908569 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.908660 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.908886 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.908978 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.909206 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.909297 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.909527 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.909618 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.909840 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.909932 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.910155 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.910247 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.910491 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.910597 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.911319 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.911457 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.911634 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.911780 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.911973 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.912099 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.912294 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.912420 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.912614 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.912793 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.912931 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.913074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.913260 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.913399 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.913574 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.913751 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.913917 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.914082 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.914231 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.914429 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.914566 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.914750 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.914876 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.915070 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.915184 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.915384 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.915497 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.915697 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.915805 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.916008 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.916129 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.916331 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.916458 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.916642 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.916768 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.916968 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.917103 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.917302 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.917411 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.917615 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.917724 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.917952 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.918049 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.918264 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.918367 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.918604 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.918687 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.918922 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.919084 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.919239 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.919325 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.919553 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.919648 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.919866 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.919952 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.920177 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.920262 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.920487 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.920571 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.920808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.920893 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.921118 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.921210 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.921427 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.921511 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.921743 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.921836 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.922054 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.922137 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.922387 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.922476 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.922702 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.922796 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.923016 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.923111 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.923330 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.923421 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.923646 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.923732 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.923958 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.924042 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.924286 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.924378 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.924605 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.924696 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.924910 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.925001 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.925237 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.925334 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.925562 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.925663 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.925871 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.925955 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.926180 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.926276 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.927076 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.927193 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.927386 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.927473 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.927694 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.927781 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.928002 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.928087 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.928312 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.928395 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.928619 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.928705 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.928926 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.929011 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.929234 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.929320 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.929554 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.929645 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.929846 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.929931 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.930154 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.930244 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.930489 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.930579 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.930795 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.930878 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.931102 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.931195 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.931409 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.931502 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.931717 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.931809 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.932030 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.932123 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.932341 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.932435 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.932688 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.932773 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.933000 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.933093 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.933329 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.933414 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.933644 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.933729 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.933962 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.934055 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.934275 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.934407 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.934612 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.934697 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.934926 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.935013 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.935241 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.935325 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.935559 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.935651 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.935870 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.935955 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.936184 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.936267 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.936496 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.936588 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.936815 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.936907 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.937130 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.937237 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.937445 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.937548 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.937752 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.937849 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.938068 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.938161 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.938418 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.938518 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.938735 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.938830 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.939057 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.939142 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.939381 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.939473 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.939695 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.939780 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.940012 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.940098 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.940326 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.940428 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.940639 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.940724 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.940949 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.941034 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.941262 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.941354 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.941579 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.941664 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.941911 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.942001 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.942227 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.942352 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.942564 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.942649 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.942880 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.942964 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.943192 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.943286 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.943504 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.943587 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.943810 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.943893 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.944128 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.944220 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.944446 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.944529 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.944758 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.944845 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.945075 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.945166 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.945387 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.945479 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.945710 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.945794 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.946024 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.946110 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.946359 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.946460 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.946675 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.946769 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.946984 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.947078 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.947294 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.947403 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.947603 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.947698 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.947914 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.948008 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.948221 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.948312 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.948532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.948691 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.948837 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.948929 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.949148 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.949232 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.949457 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.949550 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.949762 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.949843 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.950068 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.950152 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.950402 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.950507 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.950714 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.950805 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.951023 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.951107 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.951338 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.951432 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.951657 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.951747 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.951964 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.952049 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.952273 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.952359 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.952597 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.952681 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.952906 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.952996 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.953215 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.953299 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.953520 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.953607 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.953826 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.953911 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.954137 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.954254 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.954472 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.954569 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.954785 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.954878 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.955101 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.955185 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.955425 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.955517 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.955732 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.955824 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.956046 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.956126 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.956357 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.956441 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.956669 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.956762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.956987 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.957070 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.957306 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.957412 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.958129 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.958469 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.958784 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.959097 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.959410 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.959735 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.960048 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.960360 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.960670 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962492 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962581 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962652 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962719 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962785 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962852 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962918 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.962993 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.963062 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.963129 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.963307 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.963422 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.963636 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.963726 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.963968 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.964065 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.964311 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.964396 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.964640 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.964717 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.964975 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.965132 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.965281 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.965426 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.965573 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.965741 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.965904 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.966049 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.966197 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.966459 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.966605 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.966771 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.966915 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.967063 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.967221 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.967365 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.967541 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.967688 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.967868 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.967947 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.968204 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.968291 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.968535 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.968621 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.968848 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.968922 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.969162 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.969315 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.969465 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.969597 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.969753 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.969872 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.970073 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.970161 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.970404 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.970507 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.970713 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.970827 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.971017 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.971151 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.971323 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.971471 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.971729 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.971885 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.972027 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.972160 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.972303 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.972467 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.972620 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.972760 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.972945 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.973099 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.973339 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.973441 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.973612 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.973699 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.973942 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.974028 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.974252 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.974390 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.974587 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.974673 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.974895 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.974981 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.975206 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.975295 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.975517 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.975602 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.975822 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.975907 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.976132 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.976217 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.976442 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.976528 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.976754 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.976839 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.977065 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.977158 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.977370 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.977456 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.977679 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.977763 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.977983 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.978069 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.978316 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.978415 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.978629 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.978729 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.978937 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.979022 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.979241 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.979334 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.979554 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.979649 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.979864 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.979949 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.980172 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.980269 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.980480 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.980579 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.980785 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.980871 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.981104 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.981198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.981412 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.981509 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.981718 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.981867 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.982024 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.982110 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.982356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.982445 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.982670 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.982765 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.982976 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.983062 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.983295 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.983387 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.983631 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.983725 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.983908 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.983999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.984212 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.984297 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.984522 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.984607 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.984828 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.984915 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.985132 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.985218 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.985440 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.985526 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.985746 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.985838 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.986068 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.986161 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.986396 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.986484 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.986707 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.986807 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.987010 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.987102 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.987317 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.987403 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.987623 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.987717 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.987929 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.988014 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.988231 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.988331 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.988538 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.988653 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.989370 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.989459 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.989674 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.989760 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.989981 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.990074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.990298 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.990422 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.990630 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.990724 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.990932 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.991023 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.991238 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.991332 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.991541 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.991633 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.991865 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.991975 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.992175 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.992266 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.992481 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.992571 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.992791 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.992890 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.993101 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.993193 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.993414 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.993515 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.993722 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.993822 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.994029 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.994120 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.994358 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.994464 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.994669 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.994767 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.994975 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.995065 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.995287 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.995391 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.995602 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.995692 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.995907 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.995997 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.996209 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.996347 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.996516 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.996821 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.996913 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.997140 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.997236 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.997455 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.997544 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.997783 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.997870 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.998106 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.998200 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.998589 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.998699 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.998781 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.998865 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.999065 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.999160 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.999377 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.999461 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.999686 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.999772 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:33.999995 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.000091 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.000314 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.000398 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.000616 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.000712 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.000927 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.001020 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.001236 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.001321 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.001546 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.001630 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.001857 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.001943 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.002167 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.002265 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.002503 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.002589 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.002815 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.002902 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.003124 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.003211 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.003437 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.003528 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.003749 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.003834 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.004054 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.004394 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.005166 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.005326 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.005472 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.005565 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.005784 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.005869 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.006089 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.006185 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.006427 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.006547 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.006745 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.006862 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.007061 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.007167 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.007377 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.007462 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.007688 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.007773 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.008004 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.008099 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.008318 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.008403 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.008629 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.008711 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.008954 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.009048 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.009268 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.009359 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.009579 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.009663 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.009891 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.009984 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.010200 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.010303 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.010540 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.010635 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.010853 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.010940 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.011169 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.011292 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.011492 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.011614 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.011799 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.011932 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.012103 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.012247 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.012413 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.012564 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.012731 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.012881 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.013035 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.013202 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.013355 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.013522 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.013769 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.013856 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.014079 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.014244 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.014418 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.014588 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.014834 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.014920 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.015144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.015231 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.015455 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.015553 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.015777 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.015862 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.016097 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.016182 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.016420 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.016506 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.016726 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.016809 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.017036 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.017120 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.017342 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.017427 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.017666 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.017758 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.017976 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.018060 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.018302 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.018392 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.018621 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.018732 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.018927 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.019049 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.019250 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.019351 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.019571 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.019764 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.019884 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.020104 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.020231 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.020422 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.020645 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.020756 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.020971 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.021082 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.021282 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.021411 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.021609 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.021721 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.021936 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.022038 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.022245 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.022369 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.022582 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.022701 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.022892 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.023029 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.023198 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.023345 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.023506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.023662 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.023831 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.023971 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.024138 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.024296 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.024455 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.024623 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.024767 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.024942 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.025076 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.025268 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.025383 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.025687 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.025772 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.026010 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.026104 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.026336 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.026428 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.026663 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.026750 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.026978 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.027077 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.027294 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.027386 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.027608 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.027695 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.027914 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.028007 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.028222 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.028308 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.028534 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.028619 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.028839 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.028921 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.029146 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.029232 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.029451 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.029536 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.029762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.029855 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.030075 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.030169 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.030409 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.030499 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.030725 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.030813 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.031051 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.031137 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.031360 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.031445 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.031685 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.031770 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.032004 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.032089 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.032321 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.032418 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.032643 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.032740 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.032951 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.033042 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.033266 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.033359 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.033575 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.033662 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.033881 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.033966 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.034187 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.034306 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.034519 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.034613 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.034829 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.034914 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.035142 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.035238 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.035449 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.035535 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.035779 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.035865 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.036087 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.036173 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.036413 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.036500 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.036722 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.036808 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.037046 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.037132 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.037357 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.037449 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.037662 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.037755 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.037969 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.038056 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.038275 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.038407 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.038619 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.038704 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.038934 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.039024 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.039243 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.039327 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.039553 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.039647 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.039863 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.039956 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.040178 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.040263 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.040487 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.040582 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.040802 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.040894 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.041110 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.041195 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.041422 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.041519 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.041732 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.041816 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.042045 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.042130 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.042381 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.042480 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.042698 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.042817 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.043008 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.043111 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.043314 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.043407 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.043629 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.043715 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.043944 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.044029 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.044262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.044349 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.044591 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.044798 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.044916 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.045128 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.045263 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.045445 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.045533 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.045760 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.045846 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.046073 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.046169 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.046413 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.046503 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.046731 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.046819 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.047047 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.047137 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.047361 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.047447 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.047672 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.047760 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.047986 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.048072 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.048298 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.048381 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.048616 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.048701 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.048934 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.049020 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.049253 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.049339 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.049576 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.049781 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.049876 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.050116 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.050212 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.050460 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.050560 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.050787 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.050917 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.051106 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.051193 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.051933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.052020 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.052255 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.052341 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.052572 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.052657 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.052891 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.053064 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.053206 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.053292 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.053517 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.053601 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.053835 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.053934 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.054152 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.054238 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.054491 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.054581 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.054804 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.054900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.055125 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.055211 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.055442 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.055526 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.055762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.055847 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.056082 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.056168 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.056409 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.056493 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.056726 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.056813 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.057043 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.057129 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.057360 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.057454 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.057683 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.057878 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.058002 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.058195 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.058377 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.058572 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.058668 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.058900 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.058986 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.059228 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.059321 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.059547 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.059634 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.059860 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.059950 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.060180 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.060267 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.060487 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.060578 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.060796 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.060882 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.061108 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.061206 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.061419 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.061506 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.061724 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.061811 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.062044 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.062138 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.062380 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.062482 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.062689 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.062909 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.063017 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.063232 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.063329 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.063569 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.063826 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.063913 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.064175 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.064262 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.064496 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.064582 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.064829 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.064912 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.065156 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.065242 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.065464 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.065547 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.065773 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.065857 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.066086 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.066171 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.066423 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.066510 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.066731 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.066815 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.067604 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.067699 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.067920 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.068004 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.068227 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.068320 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.068534 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.068618 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.068850 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.068936 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.069164 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.069383 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.069476 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.069735 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.069821 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.070056 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.070140 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.070409 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.070498 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.070721 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.070817 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.071032 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.071169 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.071342 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.071429 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.071656 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.071749 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.071964 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.072058 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.072271 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.072363 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.072577 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.072661 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.072886 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.073000 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.073192 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.073278 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.073497 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.073583 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.073810 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.073904 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.074117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.074203 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.074446 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.074534 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.074762 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.074859 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.075068 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.075153 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.075399 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.075484 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.075709 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.075797 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.076020 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.076106 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.076325 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.076417 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.076638 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.076729 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.076946 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.077031 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.077253 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.077338 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.077562 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.077686 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.077870 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.077955 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.078186 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.078271 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.078520 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.078608 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.078832 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.079069 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.079155 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.079406 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.079492 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.079727 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.079820 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.080037 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.080123 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.080382 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.080468 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.080694 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.080780 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.081004 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.081089 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.081311 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.081404 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.081631 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.081716 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.081942 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.082026 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.082254 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.082363 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.082621 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.082709 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.082939 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.083037 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.083249 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.083335 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.083562 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.083647 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.083875 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.084122 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.084210 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.084464 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.084550 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.084776 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.084861 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.085092 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.085179 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.085401 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.085494 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.085714 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.085813 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.086029 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.086113 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.086368 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.086457 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.086694 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.086788 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.087008 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.087099 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.087324 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.087409 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.087634 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.087727 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.087946 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.088030 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.088254 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.088349 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.088564 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.088658 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.088875 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.088959 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.089187 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.089272 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.089500 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.089588 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.089803 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.089886 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.090111 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.090221 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.090444 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.090561 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.090764 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.090880 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.091116 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.091209 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.091440 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.091529 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.091760 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.091854 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.092079 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.092177 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.092398 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.092484 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.092713 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.092798 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.093021 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.093118 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.093331 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.093416 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.093641 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.093727 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.093957 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.094051 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.094322 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.094413 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.094625 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.094722 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.094933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.095020 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.095239 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.095356 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.095549 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.095675 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.095869 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.096000 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.096179 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.096312 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.096484 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.096625 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.096790 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.096950 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.097099 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.097277 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.097402 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.097592 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.097707 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.097919 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.098011 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.098258 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.098365 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.098620 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.098708 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.098961 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.099045 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.099268 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.099354 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.099571 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.099705 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.099876 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.099961 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.100181 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.100267 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.100486 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.100572 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.100795 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.100880 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.101100 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.101194 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.101404 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.101490 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.101707 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.101792 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.102010 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.102105 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.102335 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.102425 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.102645 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.102771 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.102956 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.103051 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.103265 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.103390 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.103573 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.103658 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.103885 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.103979 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.104193 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.104279 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.104500 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.104593 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.104806 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.104894 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.105113 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.105206 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.105421 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.105507 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.105728 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.105821 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.106039 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.106137 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.106375 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.106475 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.106686 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.106773 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.106993 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.107078 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.107300 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.107386 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.107607 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.107694 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.107915 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.107998 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.108240 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.108334 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.108565 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.108653 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.108873 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.108963 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.109186 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.109282 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.109500 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.109586 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.109811 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.109906 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.110125 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.110234 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.110460 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.110549 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.110777 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.110878 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.111090 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.111176 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.111400 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.111486 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.111715 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.111800 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.112025 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.112111 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.112336 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.112421 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.112649 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.112773 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.112962 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.113048 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.113273 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.113357 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.113602 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.113697 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.114460 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.114547 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.114777 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.114864 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.115105 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.115200 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.115426 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.115525 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.115751 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.115844 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.116071 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.116168 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.116386 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.116472 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.116712 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.116796 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.117024 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.117117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.117329 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.117413 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.117575 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 12:50:34.117663 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.117947 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.118260 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.118610 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.118929 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.119260 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.119592 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.119909 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.120238 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.120569 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.120920 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.121238 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.121591 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.121927 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.122248 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.122589 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.122899 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:50:34.123146 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 12:50:34.176941 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO dbcounter [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Registered counter for database nova_api May 24 12:50:34.182489 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO dbcounter [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Registered counter for database nova_api May 24 12:50:34.197059 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG oslo_db.sqlalchemy.engines [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:50:34.201764 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_db.sqlalchemy.engines [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:50:34.203703 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writer thread running {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:50:34.208789 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writer thread running {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:50:34.261919 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.context [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de0c2428-d0d8-4818-ae79-653b75265d0b(cell1) {{(pid=103027) load_cells /opt/stack/nova/nova/context.py:464}} May 24 12:50:34.265980 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.context [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de0c2428-d0d8-4818-ae79-653b75265d0b(cell1) {{(pid=103026) load_cells /opt/stack/nova/nova/context.py:464}} May 24 12:50:34.266682 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG oslo_concurrency.lockutils [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:50:34.268330 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG oslo_concurrency.lockutils [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:50:34.269135 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG oslo_concurrency.lockutils [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:50:34.270771 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:50:34.271638 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG oslo_concurrency.lockutils [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:50:34.272372 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:50:34.273173 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:50:34.273621 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO dbcounter [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Registered counter for database nova_cell0 May 24 12:50:34.275387 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:50:34.277401 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO dbcounter [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Registered counter for database nova_cell0 May 24 12:50:34.277744 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO dbcounter [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Registered counter for database nova_cell1 May 24 12:50:34.281567 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO dbcounter [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Registered counter for database nova_cell1 May 24 12:50:34.285363 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG oslo_db.sqlalchemy.engines [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:50:34.288055 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG oslo_db.sqlalchemy.engines [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:50:34.291362 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_db.sqlalchemy.engines [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:50:34.295240 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writer thread running {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:50:34.295430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_db.sqlalchemy.engines [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:50:34.295591 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writer thread running {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:50:34.298244 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writer thread running {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:50:34.439563 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writer thread running {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:50:34.440184 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO dbcounter [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Registered counter for database nova_cell0 May 24 12:50:34.448718 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO dbcounter [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Registered counter for database nova_cell0 May 24 12:50:34.449433 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG oslo_db.sqlalchemy.engines [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:50:34.453759 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writer thread running {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:50:34.457368 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_db.sqlalchemy.engines [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:50:34.462332 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writer thread running {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:50:34.797480 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: WARNING keystonemiddleware.auth_token [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 12:50:34.804759 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: WARNING keystonemiddleware.auth_token [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 12:50:34.823576 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: WARNING keystonemiddleware.auth_token [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 12:50:34.830960 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: WARNING keystonemiddleware.auth_token [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 12:50:35.151204 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: WARNING keystonemiddleware.auth_token [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 12:50:35.157159 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: WARNING keystonemiddleware.auth_token [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 12:50:35.163001 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c6df659c0 pid: 103026 (default app) May 24 12:50:35.165078 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:50:35.166255 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001735 May 24 12:50:35.166690 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Tue May 24 12:50:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:50:35.185843 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: WARNING keystonemiddleware.auth_token [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 12:50:35.192392 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: WARNING keystonemiddleware.auth_token [None req-71ef23dc-c532-4ac5-bca6-3042f5f46e62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 12:50:35.197654 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c6df659c0 pid: 103027 (default app) May 24 12:51:52.616837 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:51:52.617830 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 24 12:51:52.618498 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:51:52.631219 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writing DB stats nova_api:SELECT=3 {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:52.632073 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writing DB stats nova_cell0:SELECT=3 {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:52.633121 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writing DB stats nova_cell1:SELECT=3 {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:52.634216 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:53.082150 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-d93dc249-b0e9-40f0-b3bb-49fd34329eaf admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:51:53.114108 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-d93dc249-b0e9-40f0-b3bb-49fd34329eaf admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.488780 May 24 12:51:53.115419 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Tue May 24 12:51:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:51:55.370597 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:51:55.371677 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-83e54ce6-4835-44d6-96d7-f185c474ed11 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 24 12:51:55.372270 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:51:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:51:55.436756 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-2cc15fc8-ece6-44f1-9f39-2f0ade04170f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "ram": 256}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:51:55.455540 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:51:55.455540 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: warnings.warn(msg) May 24 12:51:55.483738 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-2cc15fc8-ece6-44f1-9f39-2f0ade04170f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105339 May 24 12:51:55.484555 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:51:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 12:51:55.497716 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_api:SELECT=3 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:55.498902 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_cell0:SELECT=3 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:55.500138 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_cell1:SELECT=3 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:55.500856 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:55.704387 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-a069a29b-6859-4da8-9849-c174db70a525 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:51:55.707410 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:51:55.707410 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: warnings.warn(msg) May 24 12:51:55.772091 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-a069a29b-6859-4da8-9849-c174db70a525 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279532 May 24 12:51:55.772862 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 12:51:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 12:51:58.018055 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-2cc15fc8-ece6-44f1-9f39-2f0ade04170f admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:51:58.019678 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-2cc15fc8-ece6-44f1-9f39-2f0ade04170f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 May 24 12:51:58.020225 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:51:58.137272 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-485c00a1-171e-4e2e-afd5-543d66014766 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:51:58.155133 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:51:58.155133 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: warnings.warn(msg) May 24 12:51:58.173006 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-485c00a1-171e-4e2e-afd5-543d66014766 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146852 May 24 12:51:58.173559 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:51:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:51:58.185903 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-d595b31d-91bb-4560-95f4-0c56128377fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:51:58.187431 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:51:58.187431 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: warnings.warn(msg) May 24 12:51:58.218896 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-d595b31d-91bb-4560-95f4-0c56128377fc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036617 May 24 12:51:58.219416 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 12:51:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 12:52:00.458326 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-485c00a1-171e-4e2e-afd5-543d66014766 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:00.459365 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-485c00a1-171e-4e2e-afd5-543d66014766 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 24 12:52:00.459928 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 12:52:00.519896 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-5601bdab-d578-4247-a36a-f5ccd680d727 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "vcpus": 1, "disk": 10}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:00.539999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-5601bdab-d578-4247-a36a-f5ccd680d727 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074436 May 24 12:52:00.541595 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:52:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:00.553251 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-e9de0050-e334-44dd-a76d-9de8a892cfab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:00.576118 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-e9de0050-e334-44dd-a76d-9de8a892cfab admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027063 May 24 12:52:00.576839 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 12:52:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:52:02.846303 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-5601bdab-d578-4247-a36a-f5ccd680d727 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:02.847826 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-5601bdab-d578-4247-a36a-f5ccd680d727 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 24 12:52:02.848232 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:02.912187 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-c4871463-100f-4fe9-af07-63c8d40514a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:02.931629 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-c4871463-100f-4fe9-af07-63c8d40514a5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076612 May 24 12:52:02.932097 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:52:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:02.943998 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-30c6b9a1-fa31-4439-841f-ecab8f48f3a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:02.969859 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-30c6b9a1-fa31-4439-841f-ecab8f48f3a0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029550 May 24 12:52:02.970631 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 12:52:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 12:52:05.258729 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-c4871463-100f-4fe9-af07-63c8d40514a5 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:05.260316 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-c4871463-100f-4fe9-af07-63c8d40514a5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 May 24 12:52:05.260970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:05.322161 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-cbcd1c28-b6ed-4811-8a7b-fb44ed3dea35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "id": "d4", "disk": 20, "name": "ds4G"}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:05.340962 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-cbcd1c28-b6ed-4811-8a7b-fb44ed3dea35 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074018 May 24 12:52:05.342340 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:52:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:05.353723 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-804614ea-055b-4fdb-a1d1-2aad051e0b2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:05.377160 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-804614ea-055b-4fdb-a1d1-2aad051e0b2a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027148 May 24 12:52:05.377867 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Tue May 24 12:52:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:52:07.611151 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-cbcd1c28-b6ed-4811-8a7b-fb44ed3dea35 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:07.612163 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-cbcd1c28-b6ed-4811-8a7b-fb44ed3dea35 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 24 12:52:07.612588 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:07.674686 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-5355e3e7-fc47-4709-92c1-95bbd8025c04 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:07.711373 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-5355e3e7-fc47-4709-92c1-95bbd8025c04 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092607 May 24 12:52:07.712307 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Tue May 24 12:52:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:52:10.033133 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-cbcd1c28-b6ed-4811-8a7b-fb44ed3dea35 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:10.034238 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-cbcd1c28-b6ed-4811-8a7b-fb44ed3dea35 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 24 12:52:10.034896 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:10.092518 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-32eeae32-4d2a-4dbb-8cce-376af64af4c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:10.110775 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-32eeae32-4d2a-4dbb-8cce-376af64af4c7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070190 May 24 12:52:10.111341 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:52:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:10.123836 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-7cbd5f9d-4389-4fff-afda-aeadd2b5d518 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:10.147573 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-7cbd5f9d-4389-4fff-afda-aeadd2b5d518 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027391 May 24 12:52:10.148145 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 12:52:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 12:52:12.401189 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-32eeae32-4d2a-4dbb-8cce-376af64af4c7 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:12.402218 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-32eeae32-4d2a-4dbb-8cce-376af64af4c7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 24 12:52:12.402709 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:12.473294 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-febaa0da-1037-4698-a29d-1e4e61ccb517 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "ram": 2048}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:12.491037 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-febaa0da-1037-4698-a29d-1e4e61ccb517 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081840 May 24 12:52:12.491598 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:52:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:12.505565 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-4efa5dd3-10b4-4402-a1c5-5ea08a80a2ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:12.528642 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-4efa5dd3-10b4-4402-a1c5-5ea08a80a2ec admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026993 May 24 12:52:12.529218 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 12:52:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 12:52:14.818041 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-febaa0da-1037-4698-a29d-1e4e61ccb517 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:14.819135 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-febaa0da-1037-4698-a29d-1e4e61ccb517 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 May 24 12:52:14.819544 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:14.880485 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-7438403e-1683-48bd-bc66-67d0bbc4b8d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "ram": 4096, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:14.898004 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-7438403e-1683-48bd-bc66-67d0bbc4b8d2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072105 May 24 12:52:14.898598 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:52:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:14.911114 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-55e01067-4342-49f1-8fe3-d633221523b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:14.933883 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-55e01067-4342-49f1-8fe3-d633221523b1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027016 May 24 12:52:14.934424 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 12:52:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:52:17.174363 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-7438403e-1683-48bd-bc66-67d0bbc4b8d2 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:17.175463 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-7438403e-1683-48bd-bc66-67d0bbc4b8d2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 May 24 12:52:17.175898 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:17.242075 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-afbfd1e9-3d26-4842-86f1-5a9f9f219385 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "id": "4"}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:17.261052 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-afbfd1e9-3d26-4842-86f1-5a9f9f219385 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078880 May 24 12:52:17.261600 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:52:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:17.274275 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-692b8405-b4e4-4388-87a4-7dcfd18f8278 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:17.298241 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-692b8405-b4e4-4388-87a4-7dcfd18f8278 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026723 May 24 12:52:17.299867 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 12:52:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:52:19.554075 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-afbfd1e9-3d26-4842-86f1-5a9f9f219385 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:19.555139 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-afbfd1e9-3d26-4842-86f1-5a9f9f219385 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 May 24 12:52:19.555824 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:19.616189 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-76fed15a-fcb9-4689-8886-0f4ca7f3e335 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "vcpus": 8}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:19.634251 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-76fed15a-fcb9-4689-8886-0f4ca7f3e335 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.072309 May 24 12:52:19.635002 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Tue May 24 12:52:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:19.647011 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-cec0a865-c818-4e82-bd31-8ee23d742729 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:19.669745 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-cec0a865-c818-4e82-bd31-8ee23d742729 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026807 May 24 12:52:19.670242 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Tue May 24 12:52:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:52:47.146200 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-76fed15a-fcb9-4689-8886-0f4ca7f3e335 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:47.147230 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-76fed15a-fcb9-4689-8886-0f4ca7f3e335 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 24 12:52:47.147625 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:47.158357 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:52:47.207451 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-4f11a0b0-2a48-41e1-8e48-e90f1c214180 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:47.224477 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-4f11a0b0-2a48-41e1-8e48-e90f1c214180 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070759 May 24 12:52:47.225015 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Tue May 24 12:52:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:52:48.195840 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-76fed15a-fcb9-4689-8886-0f4ca7f3e335 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:48.196867 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-76fed15a-fcb9-4689-8886-0f4ca7f3e335 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 24 12:52:48.197261 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:48.402335 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-d4f0ecf1-be2c-47e2-b318-7924df04130f admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:48.406399 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.wsgi [None req-d4f0ecf1-be2c-47e2-b318-7924df04130f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-d4f0ecf1-be2c-47e2-b318-7924df04130f admin admin] Request method failure captured: May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Accept: application/json May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Accept-Encoding: gzip, deflate May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Connection: keep-alive May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Content-Length: 0 May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Host: 10.222.0.45 May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Openstack-Api-Version: compute 2.90 May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Openstack-System-Scope: None May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: User-Agent: python-novaclient May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Auth-Token: gAAAAABijNUgepQDV3h7BAytT_mK8KKxKh3OQoV0MGTyivBc5kFb-vNNMEOaVfAQmWNpMXGRxduJoAf9spaNEGcaT2NAs-TLj0Xs8EvsSqAaacW_uQ9VTlqZ5P_lqL6mYe6kATGyFRjsznxlRSZM0c_-_4JlTtUOu1m31w13z-Hyl9GGAqDLXyU May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Domain-Id: None May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Domain-Name: None May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Identity-Status: Confirmed May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Is-Admin-Project: True May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Openstack-Nova-Api-Version: 2.90 May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Domain-Id: default May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Domain-Name: Default May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Name: admin May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Role: reader,member,admin May 24 12:52:48.409506 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Roles: reader,member,admin May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Tenant: admin May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Tenant-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Tenant-Name: admin May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User: admin May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Domain-Id: default May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Domain-Name: Default May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Id: c0168c20cbe64bb7a4d17219c4fe3eef May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Name: admin May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: method: > May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: exception: Flavor 42 could not be found. May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: action_args: {'id': '42'} May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 12:52:48.411117 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:48.411999 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:48.413144 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-d4f0ecf1-be2c-47e2-b318-7924df04130f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 12:52:48.414331 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-d4f0ecf1-be2c-47e2-b318-7924df04130f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063415 May 24 12:52:48.414331 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Tue May 24 12:52:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 12:52:48.420536 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-acc3e5f2-a8f5-437f-b3af-e9021e675c86 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:48.423478 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:52:48.443536 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-acc3e5f2-a8f5-437f-b3af-e9021e675c86 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026506 May 24 12:52:48.444067 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 12:52:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:52:48.453577 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-48c9d275-331a-48a3-a046-3407ca7f27b0 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:48.474795 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-48c9d275-331a-48a3-a046-3407ca7f27b0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024806 May 24 12:52:48.475363 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 12:52:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:52:48.484268 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-3466f367-0805-4e24-87f5-372716ef6d22 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:48.491342 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.wsgi [None req-3466f367-0805-4e24-87f5-372716ef6d22 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-3466f367-0805-4e24-87f5-372716ef6d22 admin admin] Request method failure captured: May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Accept: application/json May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Accept-Encoding: gzip, deflate May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Connection: keep-alive May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Content-Length: 0 May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Host: 10.222.0.45 May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Openstack-Api-Version: compute 2.90 May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Openstack-System-Scope: None May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: User-Agent: python-novaclient May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Auth-Token: gAAAAABijNUgepQDV3h7BAytT_mK8KKxKh3OQoV0MGTyivBc5kFb-vNNMEOaVfAQmWNpMXGRxduJoAf9spaNEGcaT2NAs-TLj0Xs8EvsSqAaacW_uQ9VTlqZ5P_lqL6mYe6kATGyFRjsznxlRSZM0c_-_4JlTtUOu1m31w13z-Hyl9GGAqDLXyU May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Domain-Id: None May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Domain-Name: None May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Identity-Status: Confirmed May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Is-Admin-Project: True May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Openstack-Nova-Api-Version: 2.90 May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Domain-Id: default May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Domain-Name: Default May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Name: admin May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Role: reader,member,admin May 24 12:52:48.494659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Roles: reader,member,admin May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Tenant: admin May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Tenant-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Tenant-Name: admin May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User: admin May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Domain-Id: default May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Domain-Name: Default May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Id: c0168c20cbe64bb7a4d17219c4fe3eef May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Name: admin May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: method: > May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: exception: Flavor 42 could not be found. May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: action_args: {'id': '42'} May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 12:52:48.496149 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:48.497074 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:48.498430 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-3466f367-0805-4e24-87f5-372716ef6d22 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 12:52:48.499414 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-3466f367-0805-4e24-87f5-372716ef6d22 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015274 May 24 12:52:48.499414 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Tue May 24 12:52:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 12:52:49.353768 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-48c9d275-331a-48a3-a046-3407ca7f27b0 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:49.354850 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-48c9d275-331a-48a3-a046-3407ca7f27b0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 May 24 12:52:49.355249 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 12:52:49.545835 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-49411304-a793-4d0c-94fe-cc1f1f741244 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:49.551703 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.wsgi [None req-49411304-a793-4d0c-94fe-cc1f1f741244 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-49411304-a793-4d0c-94fe-cc1f1f741244 admin admin] Request method failure captured: May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Accept: application/json May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Accept-Encoding: gzip, deflate May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Connection: keep-alive May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Content-Length: 0 May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Host: 10.222.0.45 May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Openstack-Api-Version: compute 2.90 May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Openstack-System-Scope: None May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: User-Agent: python-novaclient May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Auth-Token: gAAAAABijNUh4rv3m4NYWWhuiMIYIXH2PPWepgV2z5ZuYChy9-j6SOymQrxDf3Dhvb5D4cFqJuFllo2NB1L_wJFrtE595-noMoe-Xj6-Dx5dIrwjD2su4WBTpw4TwJPMOYx4jsL-swSWcbBLZ0VzpGVgOemQn5PtVz6sVdzQeMtF2MFdyT5E1w0 May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Domain-Id: None May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Domain-Name: None May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Identity-Status: Confirmed May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Is-Admin-Project: True May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Openstack-Nova-Api-Version: 2.90 May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Domain-Id: default May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Domain-Name: Default May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Name: admin May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Role: reader,member,admin May 24 12:52:49.553198 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Roles: reader,member,admin May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Tenant: admin May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Tenant-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Tenant-Name: admin May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User: admin May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Domain-Id: default May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Domain-Name: Default May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Id: c0168c20cbe64bb7a4d17219c4fe3eef May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Name: admin May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: method: > May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: exception: Flavor 84 could not be found. May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: action_args: {'id': '84'} May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 12:52:49.554762 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:49.555624 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:49.556933 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-49411304-a793-4d0c-94fe-cc1f1f741244 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 12:52:49.558199 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-49411304-a793-4d0c-94fe-cc1f1f741244 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061675 May 24 12:52:49.558199 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Tue May 24 12:52:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 12:52:49.564212 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-7f95a819-bd74-417c-b0ee-0fe63048a21c admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:49.579687 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-7f95a819-bd74-417c-b0ee-0fe63048a21c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019091 May 24 12:52:49.580233 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 12:52:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 12:52:49.589920 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-74294b57-e321-476e-807e-06d9b27662bc admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:49.605003 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-74294b57-e321-476e-807e-06d9b27662bc admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018519 May 24 12:52:49.605516 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 12:52:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:52:49.614477 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-1790f516-01f5-441d-b13e-43f940b8ab96 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:49.619770 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.wsgi [None req-1790f516-01f5-441d-b13e-43f940b8ab96 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-1790f516-01f5-441d-b13e-43f940b8ab96 admin admin] Request method failure captured: May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Accept: application/json May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Accept-Encoding: gzip, deflate May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Connection: keep-alive May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Content-Length: 0 May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Host: 10.222.0.45 May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Openstack-Api-Version: compute 2.90 May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Openstack-System-Scope: None May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: User-Agent: python-novaclient May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Auth-Token: gAAAAABijNUh4rv3m4NYWWhuiMIYIXH2PPWepgV2z5ZuYChy9-j6SOymQrxDf3Dhvb5D4cFqJuFllo2NB1L_wJFrtE595-noMoe-Xj6-Dx5dIrwjD2su4WBTpw4TwJPMOYx4jsL-swSWcbBLZ0VzpGVgOemQn5PtVz6sVdzQeMtF2MFdyT5E1w0 May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Domain-Id: None May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Domain-Name: None May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Identity-Status: Confirmed May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Is-Admin-Project: True May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Openstack-Nova-Api-Version: 2.90 May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Domain-Id: default May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Domain-Name: Default May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Name: admin May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Role: reader,member,admin May 24 12:52:49.621262 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Roles: reader,member,admin May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Tenant: admin May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Tenant-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Tenant-Name: admin May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User: admin May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Domain-Id: default May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Domain-Name: Default May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Id: c0168c20cbe64bb7a4d17219c4fe3eef May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Name: admin May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: method: > May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: exception: Flavor 84 could not be found. May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: action_args: {'id': '84'} May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 12:52:49.622800 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:49.624508 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:49.625559 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-1790f516-01f5-441d-b13e-43f940b8ab96 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 12:52:49.626609 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-1790f516-01f5-441d-b13e-43f940b8ab96 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011698 May 24 12:52:49.626609 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Tue May 24 12:52:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 24 12:52:50.474035 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-74294b57-e321-476e-807e-06d9b27662bc admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:50.475056 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-74294b57-e321-476e-807e-06d9b27662bc admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 24 12:52:50.475450 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:52:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:50.659616 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-caeea970-2324-4a62-acea-6f7c13f72845 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:50.665326 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.wsgi [None req-caeea970-2324-4a62-acea-6f7c13f72845 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-caeea970-2324-4a62-acea-6f7c13f72845 admin admin] Request method failure captured: May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Accept: application/json May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Accept-Encoding: gzip, deflate May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Connection: keep-alive May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Content-Length: 0 May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Host: 10.222.0.45 May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Openstack-Api-Version: compute 2.90 May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Openstack-System-Scope: None May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: User-Agent: python-novaclient May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Auth-Token: gAAAAABijNUia8_-Y1I0bK4jxEaL1KNu_gMbPeHietF_JbbUrYuHkRc9plvB0rrgH9lKNYHFRkWvOoHrVC2iMPciaw_D1H53ipmSMY2aFenTr-_oP8-y1uELaeug9BLfymSSEZPYdVSpobG9YWAYw2SAslEWRmeZ6MifMkCJkf9DBUWF-ttNiVY May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Domain-Id: None May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Domain-Name: None May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Identity-Status: Confirmed May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Is-Admin-Project: True May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Openstack-Nova-Api-Version: 2.90 May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Domain-Id: default May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Domain-Name: Default May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Project-Name: admin May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Role: reader,member,admin May 24 12:52:50.666853 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Roles: reader,member,admin May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Tenant: admin May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Tenant-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-Tenant-Name: admin May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User: admin May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Domain-Id: default May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Domain-Name: Default May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Id: c0168c20cbe64bb7a4d17219c4fe3eef May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: X-User-Name: admin May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: method: > May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: exception: Flavor 451 could not be found. May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: action_args: {'id': '451'} May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 12:52:50.668356 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:50.669309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: ERROR nova.api.openstack.wsgi May 24 12:52:50.670808 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-caeea970-2324-4a62-acea-6f7c13f72845 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 12:52:50.672029 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-caeea970-2324-4a62-acea-6f7c13f72845 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059057 May 24 12:52:50.672029 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 12:52:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 12:52:50.678332 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-5218b96f-fdba-40e1-90ad-1cc13e942a93 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:50.693009 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-5218b96f-fdba-40e1-90ad-1cc13e942a93 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018738 May 24 12:52:50.693541 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 12:52:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:52:50.703481 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:50.717369 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017489 May 24 12:52:50.717900 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Tue May 24 12:52:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:52:50.727499 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-718f2446-c4d1-44c2-a131-701c34a72efc admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:50.732810 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.wsgi [None req-718f2446-c4d1-44c2-a131-701c34a72efc admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-718f2446-c4d1-44c2-a131-701c34a72efc admin admin] Request method failure captured: May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Accept: application/json May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Accept-Encoding: gzip, deflate May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Connection: keep-alive May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Content-Length: 0 May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Host: 10.222.0.45 May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Openstack-Api-Version: compute 2.90 May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Openstack-System-Scope: None May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: User-Agent: python-novaclient May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Auth-Token: gAAAAABijNUia8_-Y1I0bK4jxEaL1KNu_gMbPeHietF_JbbUrYuHkRc9plvB0rrgH9lKNYHFRkWvOoHrVC2iMPciaw_D1H53ipmSMY2aFenTr-_oP8-y1uELaeug9BLfymSSEZPYdVSpobG9YWAYw2SAslEWRmeZ6MifMkCJkf9DBUWF-ttNiVY May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Domain-Id: None May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Domain-Name: None May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Identity-Status: Confirmed May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Is-Admin-Project: True May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Openstack-Nova-Api-Version: 2.90 May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Domain-Id: default May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Domain-Name: Default May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Project-Name: admin May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Role: reader,member,admin May 24 12:52:50.734308 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Roles: reader,member,admin May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/26aa7dae9c0c4f5a892a6fcef95c15ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Tenant: admin May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Tenant-Id: 26aa7dae9c0c4f5a892a6fcef95c15ea May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-Tenant-Name: admin May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User: admin May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Domain-Id: default May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Domain-Name: Default May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Id: c0168c20cbe64bb7a4d17219c4fe3eef May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: X-User-Name: admin May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: method: > May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: exception: Flavor 451 could not be found. May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: action_args: {'id': '451'} May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 12:52:50.735970 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:50.737532 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: ERROR nova.api.openstack.wsgi May 24 12:52:50.738900 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-718f2446-c4d1-44c2-a131-701c34a72efc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 12:52:50.740157 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-718f2446-c4d1-44c2-a131-701c34a72efc admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011904 May 24 12:52:50.740157 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 12:52:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 12:52:51.597074 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:51.598111 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 24 12:52:51.598541 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:51.785156 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-00291fbc-b61d-4d19-be28-8f87e7ce4f2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:51.802720 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-00291fbc-b61d-4d19-be28-8f87e7ce4f2f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068275 May 24 12:52:51.803295 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Tue May 24 12:52:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:52.657787 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:52.658777 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 24 12:52:52.659173 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:52:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:52.846690 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-3fd79740-3b6a-4519-bc5b-a3dc1186c19f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:52.863898 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-3fd79740-3b6a-4519-bc5b-a3dc1186c19f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067507 May 24 12:52:52.864424 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Tue May 24 12:52:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:53.726273 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:53.727309 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 24 12:52:53.727704 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:53.914899 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-2b0785e1-1d43-41c5-9277-8e8bbe751c43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:53.932154 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-2b0785e1-1d43-41c5-9277-8e8bbe751c43 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067790 May 24 12:52:53.932621 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Tue May 24 12:52:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:54.801397 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:54.802542 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 May 24 12:52:54.803013 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:52:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:54.989233 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-4012f790-3720-4586-a869-6a69e6679e50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:52:55.006237 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-4012f790-3720-4586-a869-6a69e6679e50 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067990 May 24 12:52:55.006787 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Tue May 24 12:52:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:52:55.873826 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:55.874860 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 24 12:52:55.875252 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:52:56.061217 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-11cc81a1-5e14-43d3-99de-15dbc7bb9431 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:52:56.080116 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-11cc81a1-5e14-43d3-99de-15dbc7bb9431 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070079 May 24 12:52:56.080668 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Tue May 24 12:52:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:53:57.436881 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:53:57.437877 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-673ed278-a4a1-4926-bae6-1a416bb049a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 24 12:53:57.438263 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Tue May 24 12:53:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:53:57.445689 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:53:57.496459 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-c748d772-bdee-464d-8f50-4efa059d0e7d admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:53:57.515617 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-c748d772-bdee-464d-8f50-4efa059d0e7d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071355 May 24 12:53:57.516138 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Tue May 24 12:53:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:53:57.537625 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG dbcounter [-] [103027] Writing DB stats nova_api:SELECT=14 {{(pid=103027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:53:57.541342 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-7e78d32e-3bfc-4a13-9489-6adff85a5fca admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:53:57.549019 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-7e78d32e-3bfc-4a13-9489-6adff85a5fca admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012956 May 24 12:53:57.549526 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Tue May 24 12:53:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:53:57.560659 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-d4c36bfb-61dc-4e72-86f0-1809fb714beb admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:53:57.568641 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-d4c36bfb-61dc-4e72-86f0-1809fb714beb admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011558 May 24 12:53:57.569142 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Tue May 24 12:53:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:53:57.579805 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:53:57.587228 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010899 May 24 12:53:57.587722 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Tue May 24 12:53:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:53:57.600566 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-41667977-895f-4358-9aa7-a9644bbe42fa admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:53:57.607914 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-41667977-895f-4358-9aa7-a9644bbe42fa admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011212 May 24 12:53:57.608412 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Tue May 24 12:53:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 12:57:57.256951 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:57:57.257951 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 24 12:57:57.258371 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:57:57.414744 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_api:SELECT=6 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:57:57.526893 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-df984634-87ab-4818-a440-798f4abd19bf admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:57:57.528059 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:57:57.528059 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: warnings.warn(msg) May 24 12:57:57.529259 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-df984634-87ab-4818-a440-798f4abd19bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:57:57.529696 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-df984634-87ab-4818-a440-798f4abd19bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:57:57.530514 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-df984634-87ab-4818-a440-798f4abd19bf admin admin] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:57:57.530943 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-df984634-87ab-4818-a440-798f4abd19bf admin admin] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:57:57.564672 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-df984634-87ab-4818-a440-798f4abd19bf admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155091 May 24 12:57:57.565241 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 12:57:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:57:58.447572 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:57:58.449170 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 24 12:57:58.449565 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:57:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:57:58.642315 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-e64b4743-8da7-44ed-aba9-78e1a7e74d4a admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:57:58.643521 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:57:58.643521 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: warnings.warn(msg) May 24 12:57:58.644700 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-e64b4743-8da7-44ed-aba9-78e1a7e74d4a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:57:58.645137 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-e64b4743-8da7-44ed-aba9-78e1a7e74d4a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:57:58.645913 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-e64b4743-8da7-44ed-aba9-78e1a7e74d4a admin admin] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:57:58.646363 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-e64b4743-8da7-44ed-aba9-78e1a7e74d4a admin admin] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:57:58.665568 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-e64b4743-8da7-44ed-aba9-78e1a7e74d4a admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075905 May 24 12:57:58.666056 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 12:57:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 12:58:09.944868 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:58:09.945874 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 24 12:58:09.946263 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:58:10.086048 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_cell0:SELECT=4 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:58:10.086785 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_cell1:SELECT=4 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:58:10.087397 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG dbcounter [-] [103026] Writing DB stats nova_api:SELECT=8 {{(pid=103026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:58:10.135081 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-fe063c71-df9a-4b09-b637-2296b34e1768 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:58:10.136271 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:58:10.136271 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: warnings.warn(msg) May 24 12:58:10.137984 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-fe063c71-df9a-4b09-b637-2296b34e1768 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:58:10.138462 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-fe063c71-df9a-4b09-b637-2296b34e1768 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:58:10.139241 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-fe063c71-df9a-4b09-b637-2296b34e1768 admin admin] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:58:10.139665 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-fe063c71-df9a-4b09-b637-2296b34e1768 admin admin] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:58:10.164595 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-fe063c71-df9a-4b09-b637-2296b34e1768 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082829 May 24 12:58:10.165071 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 12:58:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:58:11.032372 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: DEBUG nova.api.openstack.wsgi [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] Calling method '>' {{(pid=103027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:58:11.033385 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: INFO nova.api.openstack.requestlog [None req-e8108520-ced6-4e48-acd7-a06a668fcd86 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 24 12:58:11.033780 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: [pid: 103027|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Tue May 24 12:58:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:58:11.223684 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG nova.api.openstack.wsgi [None req-63e736e5-85bb-41a0-87ba-1d02292d9566 admin admin] Calling method '>' {{(pid=103026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:58:11.224886 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:58:11.224886 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: warnings.warn(msg) May 24 12:58:11.226051 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-63e736e5-85bb-41a0-87ba-1d02292d9566 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:58:11.226512 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-63e736e5-85bb-41a0-87ba-1d02292d9566 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:58:11.227284 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-63e736e5-85bb-41a0-87ba-1d02292d9566 admin admin] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:58:11.227702 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: DEBUG oslo_concurrency.lockutils [None req-63e736e5-85bb-41a0-87ba-1d02292d9566 admin admin] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:58:11.249399 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: INFO nova.api.openstack.requestlog [None req-63e736e5-85bb-41a0-87ba-1d02292d9566 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078043 May 24 12:58:11.249939 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: [pid: 103026|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Tue May 24 12:58:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 12:59:08.184080 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: Tue May 24 12:59:08 2022 - graceful shutdown triggered... May 24 12:59:08.184606 dv-cinder-843018-2-iscsi devstack@n-api.service[103026]: Gracefully killing worker 1 (pid: 103026)... May 24 12:59:08.184192 dv-cinder-843018-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 24 12:59:08.185429 dv-cinder-843018-2-iscsi devstack@n-api.service[103027]: Gracefully killing worker 2 (pid: 103027)... May 24 12:59:09.185294 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: worker 1 buried after 1 seconds May 24 12:59:09.185294 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: worker 2 buried after 1 seconds May 24 12:59:09.185294 dv-cinder-843018-2-iscsi devstack@n-api.service[103023]: goodbye to uWSGI. May 24 12:59:09.186784 dv-cinder-843018-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 24 12:59:09.187339 dv-cinder-843018-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 24 12:59:09.190021 dv-cinder-843018-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 12:59:09.207701 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 12:59:09 2022] *** May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: nodename: dv-cinder-843018-2-iscsi May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: machine: x86_64 May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: clock source: unix May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: pcre jit disabled May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: detected number of CPU cores: 4 May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: current working directory: / May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: detected binary path: /usr/bin/uwsgi-core May 24 12:59:09.229765 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: your processes number limit is 47680 May 24 12:59:09.231320 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: your memory page size is 4096 bytes May 24 12:59:09.231320 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: detected max file descriptor number: 2048 May 24 12:59:09.231320 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: lock engine: pthread robust mutexes May 24 12:59:09.231320 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: thunder lock: enabled May 24 12:59:09.231320 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 12:59:09.231320 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 12:59:09.275934 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: Python main interpreter initialized at 0x56178c2249c0 May 24 12:59:09.275934 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: python threads support enabled May 24 12:59:09.275934 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: your server socket listen backlog is limited to 100 connections May 24 12:59:09.275934 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: your mercy for graceful operations on workers is 90 seconds May 24 12:59:09.276395 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: mapped 403077 bytes (393 KB) for 2 cores May 24 12:59:09.276395 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: *** Operational MODE: preforking *** May 24 12:59:09.276664 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: *** uWSGI is running in multiple interpreter mode *** May 24 12:59:09.276664 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: spawned uWSGI master process (pid: 117633) May 24 12:59:09.276867 dv-cinder-843018-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 12:59:09.277744 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: spawned uWSGI worker 1 (pid: 117642, cores: 1) May 24 12:59:09.277944 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: spawned uWSGI worker 2 (pid: 117643, cores: 1) May 24 12:59:09.278986 dv-cinder-843018-2-iscsi devstack@n-api.service[117633]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 12:59:10.460181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 12:59:10.468568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 12:59:11.252525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:59:11.252525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: from cryptography.utils import int_from_bytes May 24 12:59:11.252805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:59:11.252805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: from cryptography.utils import int_from_bytes May 24 12:59:11.263337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:59:11.263337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: from cryptography.utils import int_from_bytes May 24 12:59:11.263713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:59:11.263713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: from cryptography.utils import int_from_bytes May 24 12:59:13.696641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 12:59:13.697204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 12:59:13.697488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 12:59:13.697720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 12:59:13.697983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 12:59:13.698417 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.698890 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.699272 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.699630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.699976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.700298 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.700631 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.700955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.701291 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.701559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.701882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.702214 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-2-iscsi {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.702580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.702895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.703211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.703536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.703848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.704176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.704487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.704990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.706487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.706487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.706487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.706487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.706834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.707067 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.707333 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.707647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.707972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.708299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.708713 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-2-iscsi {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.709036 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.709342 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.709673 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.710083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.710444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.710764 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.711081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.711413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.711723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.712054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.712396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.712704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.713044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.713354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.713670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.713985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.714333 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.714638 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.714954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.715286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.715602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.715932 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.716258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.716590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.716844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.717100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.717424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.717752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.718066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.718427 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.718724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.719035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.719349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.719663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.719980 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.720287 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.720613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.720934 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.721263 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.721582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.721908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.722336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.722590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.722904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.723249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.723573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.723887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.724212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.724539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.724851 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.725166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.725475 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.725801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.726132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.726468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.726725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.727059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.727340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.727663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.727974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.728325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.728609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.728913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.729225 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.729537 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.729852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.730163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.730500 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.731329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.731643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.731957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.732266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.732590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.732917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.733232 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.733545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.733857 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.734169 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.734539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.734703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 12:59:13.735210 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.735364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 12:59:13.735535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.735697 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 12:59:13.735845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.736077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 12:59:13.736242 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.736397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 12:59:13.736552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.736552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.736941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.737111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.737265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.737419 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.737575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.737740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.737894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.738041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.738196 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.738379 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.738550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.738788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.738955 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.739112 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.739266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.740059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.740318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.740485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.740646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.740802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.740961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.741580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.741826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-2-iscsi {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.741984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.742150 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.742504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.742668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.742814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.742968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.743134 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.743296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.743459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.743616 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.743763 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.743908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.744142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.744298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.744452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.744605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.744770 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.744938 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.745100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.745258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.745405 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.745558 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.745712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.745873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.746027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.746321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.747153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.747316 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.747473 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.747651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.747798 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.747951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.748106 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.748261 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.748408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.748563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.748709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.748950 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-2-iscsi {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.749366 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.749528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.749691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.749846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.750022 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.750257 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.750535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.750535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.750845 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.751003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.751157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.751315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.751471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.751826 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.752059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.752214 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.752360 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.752360 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.752774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.752936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.753084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.753236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.753613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.753772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.753927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.754088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.754243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.754416 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.754565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.754735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.754904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.755223 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.755994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.756095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.756245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.756488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.756642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.756734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.756828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.756915 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.757000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.757090 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.757261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.757353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.757496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.757636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.757727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.757813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.757813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.757987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.758072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.758166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.758253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.758430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.758520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.758613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.758706 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.758793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.758887 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.759049 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.759140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.759226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.759310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.759402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.759502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.759589 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.759681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.759768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.759852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.759944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.760039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.760133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.760254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.760392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.760510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.760645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.760748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.760836 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.760928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.761014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.761105 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.761197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.761197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.761372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.761458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.761548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.761640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.761770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.761860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.761974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.762231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.762350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.762447 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.762544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.762638 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.762731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.762849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.762937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.762937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.763107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.763203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.763296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.763296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.763457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.763542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.763640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.763726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.763818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.763903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.763992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.763992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.764164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.764250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.764341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.764436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.764527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.764624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.764710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.764916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.765012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.765232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.765326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.765548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.765695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.765866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.765966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.766157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.766266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.766482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.766603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.766790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.766891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.767104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.767202 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.767410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.767523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.767717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.767817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.768026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.768134 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.768333 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.768518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.768643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.768760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.768964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.769069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.769286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.769385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.769595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.769696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.769905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.769999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.770213 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.770332 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.770557 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.770666 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.770873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.770975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.771180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.771280 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.771489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.771596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.771800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.771895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.772103 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.772227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.772412 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.772532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.772720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.772829 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.773027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.773142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.773333 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.773440 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.773642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.773748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.773940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.774046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.774249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.774443 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.774593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.774712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.774900 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.775000 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.775224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.775335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.775512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.775605 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.775818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.775920 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.776123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.776227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.776430 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.776524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.776734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.776837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.777038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.777133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.777359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.777475 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.777687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.777791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.778014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.778108 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.778358 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.778460 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.778732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.778838 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.779041 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.779136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.779363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.779456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:59:13.779682 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.780011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.780329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.780411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.780662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.780757 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.780978 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.781077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.781305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.781388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.781616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.781732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.781936 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.782097 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.782331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.782450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.782647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.782752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.782966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.783051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.783295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.783379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.784819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.784985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785262 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.785952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.786025 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.786097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.786176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.786376 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.786498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.786709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.786825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.787026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.787136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.787348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.787456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.787682 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.787805 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.787979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.788083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.788318 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.788420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.788657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.788753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.788973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.789066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.789289 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.789404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.789617 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.789711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.789935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.790029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.790246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.790467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.790587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.790708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.790896 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.790988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.791207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.791312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.791522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.791615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.791840 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.791934 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.792153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.792303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.792466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.792559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.792773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.792874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.793088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.793676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.793926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.794040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.794236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.794351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.794585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.794681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.794904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.795019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.795227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.795336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.795540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.795641 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.795853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.795947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.796169 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.796275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.796476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.796571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.796780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.796880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.797087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.797190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.797395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.797497 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.797774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.797891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.798002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.798162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.798335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.798450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.798665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.798759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.798976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.799085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.799284 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.799388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.799607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.799710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.799918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.800024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.800229 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.800332 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.800540 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.800641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.800846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.800941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.801158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.801250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.801466 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.801558 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.801772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.801867 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.802087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.802186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.802420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.802526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.802731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.802822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.803043 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.803145 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.803349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.803442 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.803656 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.803757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.804568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.804694 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.804791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.804889 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.804977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.805080 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.805080 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.805222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.805314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.805414 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.805510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.805605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.805791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.806052 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.806147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.806488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.806592 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.806811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.806920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.807135 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.807235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.807458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.807559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.807839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.807939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.808093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.808196 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.808402 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.808511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.808715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.808817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.809571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.809676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.809883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.809976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.810191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.810315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.810553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.810664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.810861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.810954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.811170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.811274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.811477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.811578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.811783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.811874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.812084 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.812177 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.812393 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.812485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.812748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.812853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.813003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.813107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.813308 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.813408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.813611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.813703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.813918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.814018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.814239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.814385 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.814585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.814705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.814914 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.815019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.815227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.815320 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.815538 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.815646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.815848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.815950 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.816158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.816258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.816466 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.816573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.816781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.816874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.817094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.817195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.817408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.817516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.817731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.817832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.818047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.818161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.818397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.818516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.818710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.818813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.819019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.819113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.819329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.819423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.819639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.819731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.819943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.820034 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.820251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.820352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.820559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.820662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.820875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.820977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.821191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.821286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.821504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.821606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.821816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.821917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.822124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.822221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.822456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.822560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.822770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.822879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.823082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.823173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.823394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.823494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.823703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.823803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.824012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.824107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.824331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.824496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.824670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.824783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.824972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.825066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.825285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.825382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.825592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.825695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.825894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.825998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.826208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.826330 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.826546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.826643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.826855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.827009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.827195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.827297 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.827476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.827571 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.827782 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.827876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.828101 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.828228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.828416 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.828520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.828718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.828819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.829021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.829124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.829327 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.829422 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.829631 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.829723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.829941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.830045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.830248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.830445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.830607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.830701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.830917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.831086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.831223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.831316 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.831531 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.831622 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.831837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.831939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.832140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.832259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.832446 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.832539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.832758 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.832853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.833066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.833162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.833375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.833475 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.833683 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.833778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.833987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.834079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.834320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.834430 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.834646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.834955 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.835047 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.835263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.835358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.835572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.835679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.835879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.835973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.836222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.836318 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.836535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.836638 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.836841 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.836942 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.837159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.837260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.837481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.837583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.837793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.837894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.838108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.838218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.838500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.838592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.838741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.838843 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.839063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.839158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.839376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.839480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.839686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.839783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.840013 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.840120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.840334 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.840438 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.840648 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.840742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.840952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.841059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.841272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.841364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.841583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.841681 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.841895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.841997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.842205 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.842356 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.842564 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.842659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.842894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.843006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.843206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.843309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.843521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.843777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.843871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.844116 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.844211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.844436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.844538 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.844747 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.844862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.845061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.845155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.845378 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.845482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.845697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.845797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.846013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.846115 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.846354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.846452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.846668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.846775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.846977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.847070 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.847286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.847380 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.847588 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.847689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.847899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.847992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.848206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.848309 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.848510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.848606 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.848818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.848920 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.849123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.849224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.849425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.849525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.849728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.849830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.850033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.850162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.850360 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.850510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.850677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.850828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.850981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.851136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.851293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.851452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.851599 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.851767 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.851921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.852088 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.852230 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.852406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.852537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.852716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.852846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.853140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.853234 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.853457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.853552 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.853772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.853866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.854087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.854189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.854422 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.854532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.854734 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.854843 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.855050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.855152 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.855373 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.855476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.856192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.856295 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.856502 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.856599 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.856805 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.856911 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.857111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.857213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.857421 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.857515 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.857731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.857834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.858034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.858158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.858373 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.858516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.858686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.858829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.858997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.859250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.859346 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.859566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.859670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.859880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.859979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.860181 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.860277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.860497 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.860602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.860806 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.860900 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.861109 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.861205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.861415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.861523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.861725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.861821 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.862034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.862136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.862364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.862477 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.862675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.862769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.862980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.863082 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.863295 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.863397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.863599 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.863702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.863903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.863998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.864207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.864302 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.864522 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.864618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.864830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.864955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.865134 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.865286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.865456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.865606 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.865766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.865935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.866072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.866267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.866449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.866601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.866703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.866913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.867017 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.867228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.867330 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.867540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.867653 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.867851 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.867960 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.868178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.868271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.868484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.868578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.868795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.868890 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.869100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.869202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.869406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.869514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.869711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.869805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.870018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.870167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.870340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.870452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.870646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.870742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.870950 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.871055 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.871277 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.871413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.871614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.871743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.871938 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.872069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.872247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.872383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.872552 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.872712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.872852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.873029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.873135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.873338 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.873473 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.873648 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.873788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.873959 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.874396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.874592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.874707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.874912 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.875021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.875241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.875348 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.875581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.875677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.875918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.876020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.876226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.876329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.876531 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.876625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.876846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.876941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.877159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.877264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.877472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.877574 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.877776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.877871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.878079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.878182 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.878426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.878538 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.878738 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.878848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.879047 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.879179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.879360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.879463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.879672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.879781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.879986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.880089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.880291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.880387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.880597 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.880702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.880907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.881001 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.881217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.881320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.881526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.881630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.881835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.881939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.882146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.882241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.882480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.882576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.882790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.882891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.883096 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.883199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.883406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.883509 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.883712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.883852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.884021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.884127 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.884335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.884431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.884642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.884746 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.884965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.885076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.885273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.885376 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.885579 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.885676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.885885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.885991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.886190 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.886357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.886526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.886630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.886832 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.887469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.887720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.887824 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.888046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.888142 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.888370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.888476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.888677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.888780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.888990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.889092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.889304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.889401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.889620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.889720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.889931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.890157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.890265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.890550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.890664 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.890877 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.890980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.891202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.891298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.891523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.891626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.891849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.891945 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.892151 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.892245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.892466 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.892572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.892783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.892877 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.893086 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.893181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.893392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.893488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.893696 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.893801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.894019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.894116 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.894351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.894450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.894681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.894790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.895019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.895114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.895341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.895436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.895664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.895773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.895984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.896088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.896345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.896442 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.896669 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.896804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.896985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.897088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.897305 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.897399 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.897625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.897727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.897928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.898036 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.898242 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.898352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.898577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.898682 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.898902 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.898998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.899220 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.899331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.899531 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.899626 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.899840 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.899943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.900144 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.900252 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.900463 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.900554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.900783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.900875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.901097 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.901197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.901419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.901503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.901739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.901821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.902059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.902152 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.902406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.902585 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.903406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.903512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.903736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.903833 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.904046 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.904148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.904355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.904458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.904674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.904778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.904982 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.905078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.905290 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.905395 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.905616 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.905719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.905923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.906027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.906237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.906362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.906574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.906679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.906886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.906989 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.907192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.907300 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.907495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.907597 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.907817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.907913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.908123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.908226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.908445 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.908546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.908758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.908854 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.909082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.909296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.909395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.909651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.909747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.909973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.910078 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.910343 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.910454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.910631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.910736 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.910937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.911048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.911246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.911340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.911578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.911671 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.911883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.911987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.912189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.912286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.912512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.912615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.912834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.912944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.913143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.913236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.913452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.913547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.913767 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.913863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.914079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.914220 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.914414 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.914510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.914732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.914829 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.915037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.915138 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.915342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.915445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.915654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.915752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.915962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.916056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.916265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.916359 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.916571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.916675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.916878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.916972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.917179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.917284 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.917484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.917577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.917786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.917904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.918236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.918395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.918489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.918582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.918763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.918859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.919071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.919245 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.919394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.919492 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.919665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.919804 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.919970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.920079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.920312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.920416 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.920618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.920713 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.920928 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.921023 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.921239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.921342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.921561 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.921656 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.921874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.921969 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.922189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.922349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.922527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.922630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.922842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.922938 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.923158 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.923251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.923479 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.923575 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.923798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.924020 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.924115 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.924361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.924463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.924685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.924788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.925022 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.925123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.925341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.925444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.925656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.925750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.925968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.926119 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.926299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.926517 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.926665 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.926842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.926950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.927159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.927261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.927476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.927585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.927791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.927887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.928109 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.928204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.928423 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.928526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.928734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.928837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.929044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.929146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.929353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.929493 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.929662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.929765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.929977 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.930082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.930333 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.930437 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.930632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.930739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.930965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.931073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.931284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.931388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.931601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.931696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.931916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.932019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.932301 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.932408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.932543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.932636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.932857 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.932953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.933170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.933272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.933481 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.933575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.934335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.934478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.934657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.934762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.934979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.935075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.935292 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.935388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.935607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.935745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.935922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.936064 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.936215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.936391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.936528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.936719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.936841 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.937035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.937159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.937362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.937485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.937689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.937820 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.938007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.938140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.938358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.938470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.938676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.938778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.939011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.939108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.939362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.939577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.939678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.939892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.940039 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.940226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.940321 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.940551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.940646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.940877 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.940973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.941192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.941286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.941507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.941599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.941817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.941912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.942126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.942231 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.942457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.942573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.942765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.942860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.943072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.943165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.943374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.943481 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.943679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.943773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.943988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.944083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.944290 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.944396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.944594 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.944687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.944900 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.945002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.945207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.945435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.945531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.945788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.945926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.946098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.946204 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.946435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.946545 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.946789 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.946891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.947051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.947160 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.947357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.947451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.947664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.947757 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.947969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.948077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.948273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.948374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.948591 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.948693 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.948905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.949100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.949212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.949307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.950087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.950196 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.950454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.950553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.950765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.950870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.951074 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.951179 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.951385 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.951482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.951692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.951788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.952009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.952101 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.952313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.952472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.952670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.952793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.952898 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.952987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.953212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.953308 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.953518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.953621 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.953824 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.953930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.954129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.954223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.954460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.954556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.954775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.954884 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.955089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.955192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.955400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.955503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.955705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.955811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.956020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.956124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.956325 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.956467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.956635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.956739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.956970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.957071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.957290 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.957392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.957594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.957688 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.957901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.958007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.958215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.958408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.958550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.958653 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.958869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.958969 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.959177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.959270 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.959489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.959585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.959834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.959927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.960148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.960250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.960480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.960682 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.960814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.961021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.961169 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.961342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.961494 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.961675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.961845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.962010 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.962181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.962339 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.962531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.962645 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.962852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.962957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.963165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.963269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.963414 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 12:59:13.963551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.963862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.964172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.964482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.964791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.965132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.965444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.965756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.966065 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.966398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.966709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.967016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.967331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.967674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.967998 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.968312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.968629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.968945 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.969259 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.969571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.969883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.970191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.970534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.970866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.971182 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.971489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.971912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.972227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.972549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.972878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.973190 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.973512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.973835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.974147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.974495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.974826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.975145 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.975483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.975813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.976141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.976448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.976755 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.977062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.977371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.977691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.978086 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.978322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.978629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.978939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.979244 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.979549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.979854 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.980158 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.980465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.980794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.981100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.981404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.981706 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.982009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.982329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.982639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.982945 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.983247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.983549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.983851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.984155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.984486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.984818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.985140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.985463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.985777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.986099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.986429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.986751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.987072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.987389 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.987698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.988031 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.988341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.988659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.988968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.989278 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.989589 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.989898 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.990226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.990582 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.990890 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.991215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.991533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.991858 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.992177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.992493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.992824 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.993138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.993449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.993767 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.994080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.994415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.994737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.995059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.995387 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.995715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.996029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.996882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.997214 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.997563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.997881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.998228 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.998650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.998971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.999541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:13.999852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:59:14.000099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 12:59:14.022737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO dbcounter [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Registered counter for database nova_api May 24 12:59:14.042634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_db.sqlalchemy.engines [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:59:14.050121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writer thread running {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:59:14.058482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Registered counter for database nova_api May 24 12:59:14.078780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:59:14.085991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:59:14.106554 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.context [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de0c2428-d0d8-4818-ae79-653b75265d0b(cell1) {{(pid=117643) load_cells /opt/stack/nova/nova/context.py:464}} May 24 12:59:14.110685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:59:14.112260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:59:14.113073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:59:14.115121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:59:14.117074 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO dbcounter [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Registered counter for database nova_cell0 May 24 12:59:14.121055 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO dbcounter [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Registered counter for database nova_cell1 May 24 12:59:14.129173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_db.sqlalchemy.engines [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:59:14.130878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_db.sqlalchemy.engines [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:59:14.136422 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writer thread running {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:59:14.142322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writer thread running {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:59:14.143319 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.context [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de0c2428-d0d8-4818-ae79-653b75265d0b(cell1) {{(pid=117642) load_cells /opt/stack/nova/nova/context.py:464}} May 24 12:59:14.147471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:59:14.149049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:59:14.149853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 12:59:14.151882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 12:59:14.153870 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Registered counter for database nova_cell0 May 24 12:59:14.157895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Registered counter for database nova_cell1 May 24 12:59:14.165738 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:59:14.168063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:59:14.171881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:59:14.286377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO dbcounter [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Registered counter for database nova_cell0 May 24 12:59:14.294189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_db.sqlalchemy.engines [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:59:14.298964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writer thread running {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:59:14.320397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:59:14.336690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Registered counter for database nova_cell0 May 24 12:59:14.345289 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:59:14.349574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:59:14.627242 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: WARNING keystonemiddleware.auth_token [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 12:59:14.634567 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: WARNING keystonemiddleware.auth_token [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 12:59:14.676823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 12:59:14.685094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 12:59:14.982508 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: WARNING keystonemiddleware.auth_token [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 12:59:14.988590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: WARNING keystonemiddleware.auth_token [None req-05a2eeb8-4b36-49a7-9ef3-c3d034686efc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 12:59:14.993904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56178c2249c0 pid: 117643 (default app) May 24 12:59:15.031952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 12:59:15.038056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-d9790ffa-c256-4754-9428-739b5d979357 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 12:59:15.043944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56178c2249c0 pid: 117642 (default app) May 24 12:59:55.665652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:59:55.666456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:59:55.667218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:59:55.668762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:59:56.931462 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8b5a1132-02fc-40b1-bf8d-e76a8f13618b tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] Action: 'create', calling method: .version_select at 0x7f9a68735c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1239734661", "metadata": {"Type": "work"}}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:59:57.193607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:59:57.196803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:59:57.199842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:59:57.202576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:59:58.710853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-272778630", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "networks": [{"uuid": "56eab641-80af-48b6-a8c8-c5f370888566"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 12:59:59.093145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8b5a1132-02fc-40b1-bf8d-e76a8f13618b tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.435033 May 24 12:59:59.103483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Tue May 24 12:59:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3448 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 12:59:59.121009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bebb6651-3bd0-4d2a-9286-3055bb6f6a81 tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] Calling method '.version_select at 0x7f9a68581b80>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 12:59:59.276635 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bebb6651-3bd0-4d2a-9286-3055bb6f6a81 tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296" status: 200 len: 353 microversion: 2.1 time: 0.170986 May 24 12:59:59.278100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 2/2] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 12:59:59 2022] GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 12:59:59.324533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] validate_networks() for [('56eab641-80af-48b6-a8c8-c5f370888566', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:00:00.076044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0aad7324-ebe7-485e-b3a7-a0295da973ed tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a68581d30>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:00.145517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0aad7324-ebe7-485e-b3a7-a0295da973ed tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/22f2b0db-2024-415d-b7d8-7fb7bd4d3748" status: 200 len: 350 microversion: 2.1 time: 0.080200 May 24 13:00:00.147199 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 3/3] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:00:00 2022] GET /compute/v2.1/os-volumes/22f2b0db-2024-415d-b7d8-7fb7bd4d3748 => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:00.289901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-052cb425-9009-4821-9b37-61c49f4d04c9 tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] Calling method '.version_select at 0x7f9a68598430>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:00.407846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-052cb425-9009-4821-9b37-61c49f4d04c9 tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296" status: 200 len: 354 microversion: 2.1 time: 0.121572 May 24 13:00:00.408624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 4/4] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:00:00 2022] GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:00.422523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b15cfa16-1f87-42f2-bb4d-57a684d72309 tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] Calling method '.version_select at 0x7f9a68598af0>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:00.464732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:00:00.465421 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:00:00.466114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:00:00.467218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:00:00.468262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:00:00.529737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:00.530245 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:00.533121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:00.533574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:00.536078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b15cfa16-1f87-42f2-bb4d-57a684d72309 tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296" status: 200 len: 354 microversion: 2.1 time: 0.119887 May 24 13:00:00.537126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 5/5] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:00:00 2022] GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296 => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:00.554566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-66417c88-abc8-42fa-b907-e2fa082632da tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] Calling method '.version_select at 0x7f9a68598ca0>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:00.592364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Getting quotas for project cbc76452e79c4411b4592c239245cf5d. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:00:00.645957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Getting quotas for user 39adb89399764ce0af29ceea422f8fe5 and project cbc76452e79c4411b4592c239245cf5d. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:00:00.677221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:00:00.683389 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:00:00.760379 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-66417c88-abc8-42fa-b907-e2fa082632da tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296" status: 202 len: 0 microversion: 2.1 time: 0.209570 May 24 13:00:00.761848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 6/6] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 13:00:00 2022] DELETE /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:00:00.769119 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2fe2b750-3e37-438b-b438-3aa9c162107b tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] Calling method '.version_select at 0x7f9a685984c0>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:00.872454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2fe2b750-3e37-438b-b438-3aa9c162107b tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296" status: 200 len: 353 microversion: 2.1 time: 0.107179 May 24 13:00:00.873032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 7/7] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:00:00 2022] GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:00:00.883532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4183d641-90d1-459d-a22e-9d72b40833cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.699293 May 24 13:00:00.884107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1/8] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 12:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:00:00.894809 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e780ea7d-eb36-424b-a69e-9d2c30712e74 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:00.895567 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e780ea7d-eb36-424b-a69e-9d2c30712e74 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:01.218953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e780ea7d-eb36-424b-a69e-9d2c30712e74 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:01.265269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e780ea7d-eb36-424b-a69e-9d2c30712e74 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1214 microversion: 2.1 time: 0.372120 May 24 13:00:01.268770 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 8/9] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:00 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1214 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:01.892975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-da1865db-86be-4452-a9dc-503057a15f9a tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] Calling method '.version_select at 0x7f9a68530c10>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:01.894278 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-88d2a58d-9839-4832-920c-2f1fa145dae3 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a685a24c0>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:01.967985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-da1865db-86be-4452-a9dc-503057a15f9a tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] HTTP exception thrown: Volume 07113ccf-867e-480c-b982-5b0984efd296 could not be found. May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-da1865db-86be-4452-a9dc-503057a15f9a tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] Request method failure captured: May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296 HTTP/1.1 May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNbLqkxzctGg6NrjXpI4IJkCM_xy675WzXxzDnWZ3F1t2FoIAQ06lzR8NElJXWwsJhTnwSJXlcg3YLESn4jJLCSsnLUzd8l9IwG39hI51jSxzau5beYJftHBezTVD1zNqPAx07x9ji4US_5fLvZE5w7h1p6VfkPYz6KBF9oTdo_HjC0 May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 30d674774c41482ab88fb61053f56c35 May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesGetTestJSON-257414523 May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:00:01.972293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/30d674774c41482ab88fb61053f56c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/30d674774c41482ab88fb61053f56c35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_30d674774c41482ab88fb61053f56c35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/30d674774c41482ab88fb61053f56c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesGetTestJSON-257414523 May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 30d674774c41482ab88fb61053f56c35 May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesGetTestJSON-257414523 May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesGetTestJSON-257414523-project May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: ef208b9fd08940a180e3468ecd4e821f May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesGetTestJSON-257414523-project May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Volume 07113ccf-867e-480c-b982-5b0984efd296 could not be found. May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '07113ccf-867e-480c-b982-5b0984efd296'} May 24 13:00:01.973463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07113ccf-867e-480c-b982-5b0984efd296 could not be found. (HTTP 404) (Request-ID: req-a93033b0-81c3-482b-b881-d8a84b4659f6) May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:00:01.974758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:00:01.975626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07113ccf-867e-480c-b982-5b0984efd296 could not be found. May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 13:00:01.976564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07113ccf-867e-480c-b982-5b0984efd296 could not be found. May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07113ccf-867e-480c-b982-5b0984efd296 could not be found. May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-da1865db-86be-4452-a9dc-503057a15f9a tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] Returning 404 to user: Volume 07113ccf-867e-480c-b982-5b0984efd296 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-da1865db-86be-4452-a9dc-503057a15f9a tempest-VolumesGetTestJSON-257414523 tempest-VolumesGetTestJSON-257414523-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296" status: 404 len: 109 microversion: 2.1 time: 0.092137 May 24 13:00:01.979961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 2/10] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:00:01 2022] GET /compute/v2.1/os-volumes/07113ccf-867e-480c-b982-5b0984efd296 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:00:02.074691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-88d2a58d-9839-4832-920c-2f1fa145dae3 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f9ecada9-701f-4b70-b72b-7061f3fd5c6b" status: 200 len: 350 microversion: 2.1 time: 0.191524 May 24 13:00:02.075880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 9/11] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:00:01 2022] GET /compute/v2.1/os-volumes/f9ecada9-701f-4b70-b72b-7061f3fd5c6b => generated 350 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:02.285280 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-49154f18-b497-48f8-b3bc-03a8901007dd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:02.286029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-49154f18-b497-48f8-b3bc-03a8901007dd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:02.630831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-49154f18-b497-48f8-b3bc-03a8901007dd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:02.695552 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-49154f18-b497-48f8-b3bc-03a8901007dd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1214 microversion: 2.1 time: 0.413808 May 24 13:00:02.699127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 3/12] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:02 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1214 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:03.711732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b343f6db-6d01-4308-87a5-948b271c1f71 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:03.712346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b343f6db-6d01-4308-87a5-948b271c1f71 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:03.725393 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b343f6db-6d01-4308-87a5-948b271c1f71 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:03.726217 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b343f6db-6d01-4308-87a5-948b271c1f71 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:03.733745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b343f6db-6d01-4308-87a5-948b271c1f71 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:03.735935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b343f6db-6d01-4308-87a5-948b271c1f71 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:03.964172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-97852e4e-8885-4bcf-8b93-94fa8d087401 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a67429790>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:04.104386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-97852e4e-8885-4bcf-8b93-94fa8d087401 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5e1be276-ee3e-4502-ba80-1e97933cd447" status: 200 len: 350 microversion: 2.1 time: 0.150085 May 24 13:00:04.104960 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 4/13] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:00:03 2022] GET /compute/v2.1/os-volumes/5e1be276-ee3e-4502-ba80-1e97933cd447 => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:04.116932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-58428890-cf98-4d12-aba7-fc56436f6af3 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a673bd310>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:04.200280 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b343f6db-6d01-4308-87a5-948b271c1f71 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:04.226054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b343f6db-6d01-4308-87a5-948b271c1f71 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1210 microversion: 2.1 time: 0.518206 May 24 13:00:04.229370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 10/14] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:03 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1210 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:04.308883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-58428890-cf98-4d12-aba7-fc56436f6af3 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.195806 May 24 13:00:04.318688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 5/15] 10.222.0.45 () {58 vars in 1133 bytes} [Tue May 24 13:00:04 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:04.323419 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ba4c5537-49c8-4a32-8918-f95d89a5d7a7 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a684cfd30>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:04.499245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ba4c5537-49c8-4a32-8918-f95d89a5d7a7 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.180930 May 24 13:00:04.499968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 11/16] 10.222.0.45 () {58 vars in 1148 bytes} [Tue May 24 13:00:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:00:04.516586 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fd201a7a-004c-4062-82ed-0aa73bd85af6 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a67413d30>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:04.704225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fd201a7a-004c-4062-82ed-0aa73bd85af6 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.195706 May 24 13:00:04.711794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 6/17] 10.222.0.45 () {58 vars in 1133 bytes} [Tue May 24 13:00:04 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:04.716309 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2596d7cf-d574-4aab-88e4-527f3d8cea1c tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a68481310>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:05.012046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2596d7cf-d574-4aab-88e4-527f3d8cea1c tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.299402 May 24 13:00:05.012963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 12/18] 10.222.0.45 () {58 vars in 1166 bytes} [Tue May 24 13:00:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:05.025488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-37dd269d-5b1f-405d-b00a-1998459172f5 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a673bd4c0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:05.225942 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-37dd269d-5b1f-405d-b00a-1998459172f5 tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.204737 May 24 13:00:05.234542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 7/19] 10.222.0.45 () {58 vars in 1169 bytes} [Tue May 24 13:00:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:05.242878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-158cff58-dc28-46ea-af46-adb9e6db603f tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a684e9ee0>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:05.250938 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d34d42da-ad98-4264-aa8c-5e3233ed5312 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:05.259929 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d34d42da-ad98-4264-aa8c-5e3233ed5312 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:05.270556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d34d42da-ad98-4264-aa8c-5e3233ed5312 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:05.286732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d34d42da-ad98-4264-aa8c-5e3233ed5312 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:05.287936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d34d42da-ad98-4264-aa8c-5e3233ed5312 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:05.288544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d34d42da-ad98-4264-aa8c-5e3233ed5312 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:05.519718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-158cff58-dc28-46ea-af46-adb9e6db603f tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.283677 May 24 13:00:05.520287 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 13/20] 10.222.0.45 () {58 vars in 1154 bytes} [Tue May 24 13:00:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:05.531984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f94932d6-6d16-4a0a-9a32-4a648ffab50c tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a6855dc10>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:05.707368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d34d42da-ad98-4264-aa8c-5e3233ed5312 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:05.729834 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d34d42da-ad98-4264-aa8c-5e3233ed5312 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1266 microversion: 2.1 time: 0.489665 May 24 13:00:05.732931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 8/21] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:05 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1266 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:05.779162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f94932d6-6d16-4a0a-9a32-4a648ffab50c tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.250911 May 24 13:00:05.780012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 14/22] 10.222.0.45 () {58 vars in 1187 bytes} [Tue May 24 13:00:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:05.791425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-33c7354c-c38d-448b-aba4-6c81e66a3f0d tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] Calling method '.version_select at 0x7f9a67360550>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:05.990164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-33c7354c-c38d-448b-aba4-6c81e66a3f0d tempest-VolumesTestJSON-160636856 tempest-VolumesTestJSON-160636856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.202459 May 24 13:00:05.991668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 9/23] 10.222.0.45 () {58 vars in 1154 bytes} [Tue May 24 13:00:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:06.752584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8b465c09-4191-45ea-a30e-a557d3847e92 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:06.753514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8b465c09-4191-45ea-a30e-a557d3847e92 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:06.769563 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b465c09-4191-45ea-a30e-a557d3847e92 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:06.770384 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b465c09-4191-45ea-a30e-a557d3847e92 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:06.771415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b465c09-4191-45ea-a30e-a557d3847e92 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:06.772059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b465c09-4191-45ea-a30e-a557d3847e92 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:07.314743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8b465c09-4191-45ea-a30e-a557d3847e92 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:07.325539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8b465c09-4191-45ea-a30e-a557d3847e92 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1266 microversion: 2.1 time: 0.579648 May 24 13:00:07.335393 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 15/24] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:06 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1266 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:08.349357 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef387dac-87d5-48d3-974f-82803a6fb47d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:08.351814 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ef387dac-87d5-48d3-974f-82803a6fb47d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:08.380427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef387dac-87d5-48d3-974f-82803a6fb47d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:08.380891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef387dac-87d5-48d3-974f-82803a6fb47d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:08.381680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef387dac-87d5-48d3-974f-82803a6fb47d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:08.386432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef387dac-87d5-48d3-974f-82803a6fb47d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:08.590478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ef387dac-87d5-48d3-974f-82803a6fb47d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:08.603879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ef387dac-87d5-48d3-974f-82803a6fb47d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1266 microversion: 2.1 time: 0.258639 May 24 13:00:08.604319 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 10/25] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:08 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:09.620987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0a30d1dc-8925-44ca-9229-1434aa5395e5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:09.621689 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0a30d1dc-8925-44ca-9229-1434aa5395e5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:09.634250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a30d1dc-8925-44ca-9229-1434aa5395e5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:09.635654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a30d1dc-8925-44ca-9229-1434aa5395e5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:09.638268 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a30d1dc-8925-44ca-9229-1434aa5395e5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:09.638949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a30d1dc-8925-44ca-9229-1434aa5395e5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:09.851149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0a30d1dc-8925-44ca-9229-1434aa5395e5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:09.877109 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0a30d1dc-8925-44ca-9229-1434aa5395e5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1284 microversion: 2.1 time: 0.260385 May 24 13:00:09.879782 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 11/26] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:09 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1284 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:10.056569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8e6ab1ba-6350-423a-99a7-64d765613ef5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'create', calling method: .version_select at 0x7f9a6849e9d0>, body: {"keypair": {"name": "tempest-keypair-540075073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU9L3d9w9K77N0FVaGnjooaXQglwetdDxT2JJ2JdlI+apQd/+2Wpr6M1pqPx/BU7jW7nVORQoqi/5SxnXgYwjdBdIQXF9pOmbY4SYvVLOyuOEfY7IdT3YQ9zxQgsQrmAg=="}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:10.139034 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-8e6ab1ba-6350-423a-99a7-64d765613ef5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Getting quotas for project e57720cd453848a89315ad87ace38161. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:00:10.155274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-8e6ab1ba-6350-423a-99a7-64d765613ef5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Getting quotas for user f7b0dfb3d6514817aba4ab34fd972ba1 and project e57720cd453848a89315ad87ace38161. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:00:10.267822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8e6ab1ba-6350-423a-99a7-64d765613ef5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.667888 May 24 13:00:10.275236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 16/27] 10.222.0.45 () {62 vars in 1199 bytes} [Tue May 24 13:00:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 676 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 24 13:00:10.897893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-420f8654-84a8-4eb6-99b3-a323f21d6a75 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:10.900279 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-420f8654-84a8-4eb6-99b3-a323f21d6a75 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:10.923179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:10.925681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-420f8654-84a8-4eb6-99b3-a323f21d6a75 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:10.926438 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-420f8654-84a8-4eb6-99b3-a323f21d6a75 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:10.927481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-420f8654-84a8-4eb6-99b3-a323f21d6a75 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:10.928022 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-420f8654-84a8-4eb6-99b3-a323f21d6a75 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:11.077265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-420f8654-84a8-4eb6-99b3-a323f21d6a75 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:11.093019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-420f8654-84a8-4eb6-99b3-a323f21d6a75 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1272 microversion: 2.1 time: 0.198838 May 24 13:00:11.094077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 12/28] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:10 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:12.114325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-14027d81-cc28-4f59-8768-2bc851062dc7 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:12.114325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-14027d81-cc28-4f59-8768-2bc851062dc7 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:12.120374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-14027d81-cc28-4f59-8768-2bc851062dc7 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:12.120835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-14027d81-cc28-4f59-8768-2bc851062dc7 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:12.121630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-14027d81-cc28-4f59-8768-2bc851062dc7 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:12.122088 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-14027d81-cc28-4f59-8768-2bc851062dc7 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:12.507569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-14027d81-cc28-4f59-8768-2bc851062dc7 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:12.518958 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-14027d81-cc28-4f59-8768-2bc851062dc7 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1272 microversion: 2.1 time: 0.411263 May 24 13:00:12.523923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 17/29] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:12 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1272 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:13.545746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ed805b5a-e368-42f3-9c84-ede418390229 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:13.547884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ed805b5a-e368-42f3-9c84-ede418390229 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:13.561033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=8 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:13.566787 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed805b5a-e368-42f3-9c84-ede418390229 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:13.570109 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed805b5a-e368-42f3-9c84-ede418390229 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:13.571267 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed805b5a-e368-42f3-9c84-ede418390229 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:13.573517 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed805b5a-e368-42f3-9c84-ede418390229 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:14.669822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ed805b5a-e368-42f3-9c84-ede418390229 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:14.684346 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ed805b5a-e368-42f3-9c84-ede418390229 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1272 microversion: 2.1 time: 1.147571 May 24 13:00:14.698826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 13/30] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:13 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1272 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:15.703489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5b360286-4c99-4df7-ba92-fea2ef627eb5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:15.704754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5b360286-4c99-4df7-ba92-fea2ef627eb5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:15.720765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b360286-4c99-4df7-ba92-fea2ef627eb5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:15.734327 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b360286-4c99-4df7-ba92-fea2ef627eb5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:15.740078 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b360286-4c99-4df7-ba92-fea2ef627eb5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:15.740809 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b360286-4c99-4df7-ba92-fea2ef627eb5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:16.439511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7140d8e2-595a-4cac-961d-cc7e6e9255d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'create', calling method: .version_select at 0x7f9a67bb80d0>, body: {"keypair": {"name": "tempest-keypair-2113186983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhye1UbATn3mMZ2CdHmmUmZ8KLWfg+lvdbj3emhLPIbeVMt+VqEdnaPd4hYNrS9JDpS1qWHffjUsChlmf6LKKg5RxMfvjzl06uLcQ9Wii8w1HijrJlsvlou4t7jyDwCtA=="}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:16.489347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-7140d8e2-595a-4cac-961d-cc7e6e9255d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Getting quotas for project 728de65d013a489594d837589c7b978b. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:00:16.505496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-7140d8e2-595a-4cac-961d-cc7e6e9255d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Getting quotas for user cb3d46a7a0ae40e9b157b7199b18de27 and project 728de65d013a489594d837589c7b978b. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:00:16.570829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7140d8e2-595a-4cac-961d-cc7e6e9255d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.027594 May 24 13:00:16.571464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 18/31] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 13:00:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:16.666405 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1929430725", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd77132b-867d-43d4-a692-2741204d16c7"}], "security_groups": [{"name": "tempest-securitygroup--407503942"}], "key_name": "tempest-keypair-540075073", "user_data": "}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:16.875892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5b360286-4c99-4df7-ba92-fea2ef627eb5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:16.885232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5b360286-4c99-4df7-ba92-fea2ef627eb5 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 1.184843 May 24 13:00:16.896144 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 14/32] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:15 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:17.105153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.network.neutron [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] validate_networks() for [('dd77132b-867d-43d4-a692-2741204d16c7', None, None, None, None, None)] {{(pid=117643) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:00:17.913670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3c78608e-09b6-4c57-bc67-19cf4d8d502e tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:17.914437 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c78608e-09b6-4c57-bc67-19cf4d8d502e tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:17.924382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c78608e-09b6-4c57-bc67-19cf4d8d502e tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:17.930448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c78608e-09b6-4c57-bc67-19cf4d8d502e tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:17.939825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c78608e-09b6-4c57-bc67-19cf4d8d502e tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:17.942051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c78608e-09b6-4c57-bc67-19cf4d8d502e tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:19.322953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3c78608e-09b6-4c57-bc67-19cf4d8d502e tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:19.366763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3c78608e-09b6-4c57-bc67-19cf4d8d502e tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 1.452312 May 24 13:00:19.370838 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 15/33] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:17 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:19.551107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Flavor limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:00:19.552231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Image limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:00:19.552869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Flavor pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:00:19.553428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Image pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:00:19.554009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:00:19.578634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:19.593301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:19.594402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:19.598771 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:19.662934 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Getting quotas for project e57720cd453848a89315ad87ace38161. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:00:19.692681 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Getting quotas for user f7b0dfb3d6514817aba4ab34fd972ba1 and project e57720cd453848a89315ad87ace38161. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:00:19.735783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Going to run 1 instances... {{(pid=117643) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:00:19.744033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:00:19.955101 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0b41707c-48b5-4742-a944-2bc1020df441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.294238 May 24 13:00:19.957209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 19/34] 10.222.0.45 () {62 vars in 1187 bytes} [Tue May 24 13:00:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 3296 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 13:00:19.969739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c5b85151-5ef0-4963-ba67-d53d4f50eab0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:19.970932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c5b85151-5ef0-4963-ba67-d53d4f50eab0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:20.387097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9973c368-a789-49ea-b4c0-c262df4634b4 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:20.387728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9973c368-a789-49ea-b4c0-c262df4634b4 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:20.410016 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9973c368-a789-49ea-b4c0-c262df4634b4 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:20.410456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9973c368-a789-49ea-b4c0-c262df4634b4 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:20.411253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9973c368-a789-49ea-b4c0-c262df4634b4 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:20.411697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9973c368-a789-49ea-b4c0-c262df4634b4 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:20.456061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c5b85151-5ef0-4963-ba67-d53d4f50eab0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:20.468109 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c5b85151-5ef0-4963-ba67-d53d4f50eab0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:20.476095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c5b85151-5ef0-4963-ba67-d53d4f50eab0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:20.477384 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c5b85151-5ef0-4963-ba67-d53d4f50eab0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1281 microversion: 2.20 time: 0.514072 May 24 13:00:20.479691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 16/35] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:19 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1281 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:22.038184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-988777381", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:22.102309 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9973c368-a789-49ea-b4c0-c262df4634b4 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:22.110829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9973c368-a789-49ea-b4c0-c262df4634b4 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 1.728045 May 24 13:00:22.139756 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 20/36] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:20 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:22.152457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:22.153760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:22.169267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:22.170383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:22.171454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:22.172150 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] validate_networks() for [('bbcecfd4-b0fe-4041-9185-a83b5cc7e769', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:00:22.172262 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:22.421391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:22.436339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:22.440580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:22.442126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e014c890-2007-400f-a92f-286a9afd61cc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1285 microversion: 2.20 time: 0.301098 May 24 13:00:22.475200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 21/37] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:22 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1285 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:23.423106 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-8917787a-452e-47b1-9da2-f002802f48a9 req-87d551ac-302f-454d-9dcf-26d3732b5eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f71a38-48c3-4411-98c8-00beab5f55b3", "tag": "cf875030-2a08-4025-876f-dccb6cfa7b28"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:23.459790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-8917787a-452e-47b1-9da2-f002802f48a9 req-87d551ac-302f-454d-9dcf-26d3732b5eaa service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:23.460480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-8917787a-452e-47b1-9da2-f002802f48a9 req-87d551ac-302f-454d-9dcf-26d3732b5eaa service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:23.577556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-8917787a-452e-47b1-9da2-f002802f48a9 req-87d551ac-302f-454d-9dcf-26d3732b5eaa service nova] Creating event network-changed:cf875030-2a08-4025-876f-dccb6cfa7b28 for instance a5f71a38-48c3-4411-98c8-00beab5f55b3 on hv-cinder-84301 May 24 13:00:23.578125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-8917787a-452e-47b1-9da2-f002802f48a9 req-87d551ac-302f-454d-9dcf-26d3732b5eaa service nova] Acquired lock "compute-rpcapi-router" {{(pid=117643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 13:00:23.583040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3594e996-1b7b-4d78-bedf-da99510f5f1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:23.583505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3594e996-1b7b-4d78-bedf-da99510f5f1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:23.584360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3594e996-1b7b-4d78-bedf-da99510f5f1a None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:23.584791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3594e996-1b7b-4d78-bedf-da99510f5f1a None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:23.616908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.compute.rpcapi [None req-3594e996-1b7b-4d78-bedf-da99510f5f1a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 13:00:23.617822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3594e996-1b7b-4d78-bedf-da99510f5f1a None None] Releasing lock "compute-rpcapi-router" {{(pid=117643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 13:00:23.670376 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3594e996-1b7b-4d78-bedf-da99510f5f1a None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.762956 May 24 13:00:23.671495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 22/38] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:23.678489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f8c6d1f6-ad2a-4db0-80f9-090a8d92b497 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:23.679444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f8c6d1f6-ad2a-4db0-80f9-090a8d92b497 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:23.705698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8c6d1f6-ad2a-4db0-80f9-090a8d92b497 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:23.710875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8c6d1f6-ad2a-4db0-80f9-090a8d92b497 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:23.711879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8c6d1f6-ad2a-4db0-80f9-090a8d92b497 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:23.712502 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8c6d1f6-ad2a-4db0-80f9-090a8d92b497 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:24.083374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:00:24.083959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:00:24.085580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:00:24.086348 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:00:24.087112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:00:24.100717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:24.101658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:24.103771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:24.104695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:24.129959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Getting quotas for project a92196ee4d214c999d303c7f8e28a9ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:00:24.136371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Getting quotas for user 91a76f7af8a5467bbf567ca5b9db9ce0 and project a92196ee4d214c999d303c7f8e28a9ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:00:24.150919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:00:24.154931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:00:24.267336 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1fd4c4c0-cf24-4ad3-b6b1-466a9064e9fd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.913539 May 24 13:00:24.272450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 17/39] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:00:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:00:24.280219 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2054319211", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee4ef809-826a-4a41-8592-dda9f9d87ae5"}], "security_groups": [{"name": "tempest-securitygroup--1012303669"}], "key_name": "tempest-keypair-2113186983", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:24.718526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] validate_networks() for [('ee4ef809-826a-4a41-8592-dda9f9d87ae5', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:00:25.233021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f8c6d1f6-ad2a-4db0-80f9-090a8d92b497 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:25.263866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f8c6d1f6-ad2a-4db0-80f9-090a8d92b497 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 1.590498 May 24 13:00:25.271505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 23/40] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:23 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:25.277336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:25.297787 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:25.318508 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:25.319272 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:25.320383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:25.321013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:25.637792 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:25.656142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:25.671136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:25.677788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c472c489-07d2-4344-a873-5f9dee65304b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1339 microversion: 2.20 time: 0.404708 May 24 13:00:25.678938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 24/41] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:25 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1339 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:25.696048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-44d7df60-59fd-4874-92d7-f94d1af5db8b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:25.704882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-44d7df60-59fd-4874-92d7-f94d1af5db8b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:25.714154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=5 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:25.740616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44d7df60-59fd-4874-92d7-f94d1af5db8b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:25.741697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44d7df60-59fd-4874-92d7-f94d1af5db8b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:25.742795 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44d7df60-59fd-4874-92d7-f94d1af5db8b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:25.743542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44d7df60-59fd-4874-92d7-f94d1af5db8b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:25.800225 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=49 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:25.996975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-44d7df60-59fd-4874-92d7-f94d1af5db8b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:26.013873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-44d7df60-59fd-4874-92d7-f94d1af5db8b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1217 microversion: 2.1 time: 0.328076 May 24 13:00:26.034658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 25/42] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:25 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1217 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:26.288299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0233f7e2-b58b-47dd-b568-d71f00fd2287 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:26.289180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0233f7e2-b58b-47dd-b568-d71f00fd2287 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:26.315565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0233f7e2-b58b-47dd-b568-d71f00fd2287 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:26.318247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0233f7e2-b58b-47dd-b568-d71f00fd2287 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:26.319221 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0233f7e2-b58b-47dd-b568-d71f00fd2287 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:26.327296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0233f7e2-b58b-47dd-b568-d71f00fd2287 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:27.357222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:00:27.357832 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:00:27.358386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:00:27.358842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:00:27.359668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:00:27.369686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:27.396453 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:27.398558 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:27.399724 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:27.400230 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:27.417058 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=47 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:27.432128 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Getting quotas for project 728de65d013a489594d837589c7b978b. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:00:27.439861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Getting quotas for user cb3d46a7a0ae40e9b157b7199b18de27 and project 728de65d013a489594d837589c7b978b. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:00:27.454057 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:00:27.456943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:00:27.519834 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3c5b50f6-c090-48fc-894c-8998d0a2cbc3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.244864 May 24 13:00:27.526816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 18/43] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:00:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 3254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:00:27.534366 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1383187468", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:27.628071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] validate_networks() for [('bbcecfd4-b0fe-4041-9185-a83b5cc7e769', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:00:27.720092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0233f7e2-b58b-47dd-b568-d71f00fd2287 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:27.731670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0233f7e2-b58b-47dd-b568-d71f00fd2287 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 1.447484 May 24 13:00:27.732586 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 26/44] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:26 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:27.738241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:27.739127 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:27.760136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:27.762063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:27.764104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:27.764772 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:27.920301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:27.928641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:27.930204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:27.931452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8ac69842-7de7-4f64-8a5a-fc0075575280 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1339 microversion: 2.20 time: 0.197290 May 24 13:00:27.940856 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 27/45] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:27 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1339 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:27.945870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1680dc0d-8833-4a18-a5be-6833d48d4ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:27.950708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1680dc0d-8833-4a18-a5be-6833d48d4ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:28.065305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1680dc0d-8833-4a18-a5be-6833d48d4ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:28.067534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=17 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:28.073304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1680dc0d-8833-4a18-a5be-6833d48d4ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1238 microversion: 2.1 time: 0.131151 May 24 13:00:28.073900 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 28/46] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:27 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1238 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:28.349399 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:00:28.350110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:00:28.350844 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:00:28.363755 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:00:28.367144 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:00:28.453396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:28.456531 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:28.466027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:28.467778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:28.524077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Getting quotas for project a92196ee4d214c999d303c7f8e28a9ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:00:28.543481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Getting quotas for user 91a76f7af8a5467bbf567ca5b9db9ce0 and project a92196ee4d214c999d303c7f8e28a9ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:00:28.566709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:00:28.569086 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:00:28.639053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6c24844d-5b8b-406d-9258-d6052147d72f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.109966 May 24 13:00:28.640027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 19/47] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:00:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:00:28.651932 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-505e74c9-33d2-4ff5-a510-46f8c2f7adcf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:28.652746 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-505e74c9-33d2-4ff5-a510-46f8c2f7adcf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:28.749074 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-117776f4-23bd-4982-99be-cccc8e7466c3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:28.750059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-117776f4-23bd-4982-99be-cccc8e7466c3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:28.768191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117776f4-23bd-4982-99be-cccc8e7466c3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:28.773090 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117776f4-23bd-4982-99be-cccc8e7466c3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:28.775048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117776f4-23bd-4982-99be-cccc8e7466c3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:28.776116 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117776f4-23bd-4982-99be-cccc8e7466c3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:28.991456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-505e74c9-33d2-4ff5-a510-46f8c2f7adcf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:29.010930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-505e74c9-33d2-4ff5-a510-46f8c2f7adcf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1222 microversion: 2.1 time: 0.363510 May 24 13:00:29.022723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-117776f4-23bd-4982-99be-cccc8e7466c3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:29.039743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 29/48] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:28 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1222 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:29.048703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-117776f4-23bd-4982-99be-cccc8e7466c3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.303648 May 24 13:00:29.056558 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 20/49] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:28 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:29.090874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-13119540-62ad-434a-a63c-7901cb9fb363 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:29.091692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-13119540-62ad-434a-a63c-7901cb9fb363 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:29.094312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:29.095381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:29.100654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13119540-62ad-434a-a63c-7901cb9fb363 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:29.101970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13119540-62ad-434a-a63c-7901cb9fb363 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:29.101970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13119540-62ad-434a-a63c-7901cb9fb363 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:29.116265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13119540-62ad-434a-a63c-7901cb9fb363 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:29.133630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:29.136516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:29.138094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:29.138764 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:29.455720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-13119540-62ad-434a-a63c-7901cb9fb363 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:29.482504 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-13119540-62ad-434a-a63c-7901cb9fb363 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.395397 May 24 13:00:29.497909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 21/50] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:29 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:29.745636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:29.755783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:29.757572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:29.759570 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-decfb5cc-0529-4e9d-b811-a64069fe393c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.718190 May 24 13:00:29.771584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 30/51] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:29 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:30.044534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6149492f-8bdc-46d7-85e4-3afd6c30213a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:30.045418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6149492f-8bdc-46d7-85e4-3afd6c30213a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:30.058862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6149492f-8bdc-46d7-85e4-3afd6c30213a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:30.059323 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6149492f-8bdc-46d7-85e4-3afd6c30213a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:30.061709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6149492f-8bdc-46d7-85e4-3afd6c30213a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:30.067564 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6ff7c16a-4669-4a1d-9045-24a6a7d0c314 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:30.068192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6ff7c16a-4669-4a1d-9045-24a6a7d0c314 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:30.072293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6149492f-8bdc-46d7-85e4-3afd6c30213a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:30.077630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6ff7c16a-4669-4a1d-9045-24a6a7d0c314 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:30.078082 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6ff7c16a-4669-4a1d-9045-24a6a7d0c314 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:30.086258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6ff7c16a-4669-4a1d-9045-24a6a7d0c314 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:30.086814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6ff7c16a-4669-4a1d-9045-24a6a7d0c314 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:30.281862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6149492f-8bdc-46d7-85e4-3afd6c30213a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:30.299342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6149492f-8bdc-46d7-85e4-3afd6c30213a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.259229 May 24 13:00:30.308321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 22/52] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:30 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:30.501462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1596c5a-3a10-43cc-a3f7-540650e4bfbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:30.502028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c1596c5a-3a10-43cc-a3f7-540650e4bfbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:30.508750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1596c5a-3a10-43cc-a3f7-540650e4bfbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:30.510171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1596c5a-3a10-43cc-a3f7-540650e4bfbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:30.511349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1596c5a-3a10-43cc-a3f7-540650e4bfbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:30.512435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1596c5a-3a10-43cc-a3f7-540650e4bfbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:30.526607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6ff7c16a-4669-4a1d-9045-24a6a7d0c314 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:30.533942 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6ff7c16a-4669-4a1d-9045-24a6a7d0c314 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.470843 May 24 13:00:30.535121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 31/53] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:30 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:30.607322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c1596c5a-3a10-43cc-a3f7-540650e4bfbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:30.616165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c1596c5a-3a10-43cc-a3f7-540650e4bfbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.118597 May 24 13:00:30.616756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 23/54] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:30 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:30.778879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:30.779587 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:30.786691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:30.787402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:30.788792 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:30.789496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:31.321180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c04cd01f-d54d-4dd3-8b6b-783254b6a2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:31.321986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c04cd01f-d54d-4dd3-8b6b-783254b6a2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:31.331952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c04cd01f-d54d-4dd3-8b6b-783254b6a2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:31.332605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c04cd01f-d54d-4dd3-8b6b-783254b6a2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:31.334437 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c04cd01f-d54d-4dd3-8b6b-783254b6a2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:31.335653 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c04cd01f-d54d-4dd3-8b6b-783254b6a2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:31.349924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:31.366340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:31.369292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:31.373214 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-437fdebb-e557-49f8-a6fe-201ab776e57a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.598846 May 24 13:00:31.373796 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 32/55] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:30 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:31.448990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c04cd01f-d54d-4dd3-8b6b-783254b6a2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:31.458968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c04cd01f-d54d-4dd3-8b6b-783254b6a2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.141710 May 24 13:00:31.460587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 24/56] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:31 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:31.551045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-38a42992-19a0-4cd4-909e-dd9196c6553b tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:31.551670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-38a42992-19a0-4cd4-909e-dd9196c6553b tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:31.558329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38a42992-19a0-4cd4-909e-dd9196c6553b tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:31.559077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38a42992-19a0-4cd4-909e-dd9196c6553b tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:31.559868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38a42992-19a0-4cd4-909e-dd9196c6553b tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:31.560688 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38a42992-19a0-4cd4-909e-dd9196c6553b tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:31.632878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-caf1d968-4798-4643-b47d-bb0cf4e03ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:31.634675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-caf1d968-4798-4643-b47d-bb0cf4e03ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:31.641644 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-caf1d968-4798-4643-b47d-bb0cf4e03ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:31.642232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-caf1d968-4798-4643-b47d-bb0cf4e03ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:31.643158 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-caf1d968-4798-4643-b47d-bb0cf4e03ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:31.643729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-caf1d968-4798-4643-b47d-bb0cf4e03ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:31.708693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-caf1d968-4798-4643-b47d-bb0cf4e03ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:31.718564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-caf1d968-4798-4643-b47d-bb0cf4e03ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.089494 May 24 13:00:31.729456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 25/57] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:31 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:31.752871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-38a42992-19a0-4cd4-909e-dd9196c6553b tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:31.761502 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-38a42992-19a0-4cd4-909e-dd9196c6553b tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.214216 May 24 13:00:31.762176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 33/58] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:31 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:32.395318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:32.395996 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:32.404182 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:32.404628 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:32.405401 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:32.405826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:32.476600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-343b5a0f-0beb-46d2-b935-492956caa19b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:32.477213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-343b5a0f-0beb-46d2-b935-492956caa19b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:32.494830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-343b5a0f-0beb-46d2-b935-492956caa19b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:32.495759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-343b5a0f-0beb-46d2-b935-492956caa19b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:32.497132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-343b5a0f-0beb-46d2-b935-492956caa19b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:32.497829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-343b5a0f-0beb-46d2-b935-492956caa19b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:32.574922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-343b5a0f-0beb-46d2-b935-492956caa19b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:32.581634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:32.585635 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-343b5a0f-0beb-46d2-b935-492956caa19b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.112764 May 24 13:00:32.586458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 34/59] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:32 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:32.599728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:32.602456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:32.603796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a6b3d0d-63f0-4443-b629-d1f5f4e95b56 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.216207 May 24 13:00:32.604483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 26/60] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:32 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:32.737847 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7045fb3a-79d6-4143-900c-1fa3834ff8f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:32.740995 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7045fb3a-79d6-4143-900c-1fa3834ff8f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:32.748667 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7045fb3a-79d6-4143-900c-1fa3834ff8f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:32.749180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7045fb3a-79d6-4143-900c-1fa3834ff8f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:32.750020 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7045fb3a-79d6-4143-900c-1fa3834ff8f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:32.750547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7045fb3a-79d6-4143-900c-1fa3834ff8f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:32.781571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-57c43852-f16c-40fd-8d82-2bf6cc9bd8c0 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:32.783241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-57c43852-f16c-40fd-8d82-2bf6cc9bd8c0 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:32.796867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c43852-f16c-40fd-8d82-2bf6cc9bd8c0 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:32.797526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c43852-f16c-40fd-8d82-2bf6cc9bd8c0 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:32.798434 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c43852-f16c-40fd-8d82-2bf6cc9bd8c0 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:32.799009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c43852-f16c-40fd-8d82-2bf6cc9bd8c0 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:32.817179 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7045fb3a-79d6-4143-900c-1fa3834ff8f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:32.828035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7045fb3a-79d6-4143-900c-1fa3834ff8f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.094153 May 24 13:00:32.829639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 35/61] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:32 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:32.964815 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57c43852-f16c-40fd-8d82-2bf6cc9bd8c0 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:32.973123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-57c43852-f16c-40fd-8d82-2bf6cc9bd8c0 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.198913 May 24 13:00:32.973874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 27/62] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:32 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:33.602718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bd900be8-6348-4761-9bcd-26b202bbb8ff tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:33.603895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bd900be8-6348-4761-9bcd-26b202bbb8ff tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:33.610032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd900be8-6348-4761-9bcd-26b202bbb8ff tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:33.610528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd900be8-6348-4761-9bcd-26b202bbb8ff tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:33.611307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd900be8-6348-4761-9bcd-26b202bbb8ff tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:33.611747 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd900be8-6348-4761-9bcd-26b202bbb8ff tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:33.616206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=4 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:33.626217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:33.627058 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:33.635319 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:33.635781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:33.636565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:33.637004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:33.676673 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bd900be8-6348-4761-9bcd-26b202bbb8ff tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:33.685073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bd900be8-6348-4761-9bcd-26b202bbb8ff tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.086203 May 24 13:00:33.686156 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 36/63] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:33 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:33.787771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:33.797730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:33.799650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:33.800762 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f03eae5d-3410-4237-925c-d6ee70a7d7c2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.181538 May 24 13:00:33.801317 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 28/64] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:33 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:33.845940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d23c4d07-7298-4ad8-94d0-ce4ab54f130b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:33.846840 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d23c4d07-7298-4ad8-94d0-ce4ab54f130b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:33.853692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d23c4d07-7298-4ad8-94d0-ce4ab54f130b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:33.854243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d23c4d07-7298-4ad8-94d0-ce4ab54f130b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:33.855201 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d23c4d07-7298-4ad8-94d0-ce4ab54f130b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:33.855964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d23c4d07-7298-4ad8-94d0-ce4ab54f130b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:33.926361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d23c4d07-7298-4ad8-94d0-ce4ab54f130b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:33.931445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d23c4d07-7298-4ad8-94d0-ce4ab54f130b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.090108 May 24 13:00:33.932019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 37/65] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:33 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:33.989986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8ab71f78-ef9f-4270-a59e-81f72d7064cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:33.990663 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8ab71f78-ef9f-4270-a59e-81f72d7064cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:33.996933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab71f78-ef9f-4270-a59e-81f72d7064cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:33.997636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab71f78-ef9f-4270-a59e-81f72d7064cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:33.998901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab71f78-ef9f-4270-a59e-81f72d7064cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:33.999347 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab71f78-ef9f-4270-a59e-81f72d7064cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:34.150617 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ab71f78-ef9f-4270-a59e-81f72d7064cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:34.158014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8ab71f78-ef9f-4270-a59e-81f72d7064cf tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.172247 May 24 13:00:34.158761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 29/66] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:33 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:34.704737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-93797952-b12d-4c5e-83ee-095eb2db294e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:34.705512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-93797952-b12d-4c5e-83ee-095eb2db294e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:34.711496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93797952-b12d-4c5e-83ee-095eb2db294e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:34.711947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93797952-b12d-4c5e-83ee-095eb2db294e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:34.712707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93797952-b12d-4c5e-83ee-095eb2db294e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:34.713346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93797952-b12d-4c5e-83ee-095eb2db294e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:34.773942 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-93797952-b12d-4c5e-83ee-095eb2db294e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:34.781529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-93797952-b12d-4c5e-83ee-095eb2db294e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.083374 May 24 13:00:34.782259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 38/67] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:34 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:34.818914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:34.819614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:34.826275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:34.826837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:34.827617 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:34.828057 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:34.948706 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1952dac9-0d3e-455b-bb60-ca5980145381 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:34.949326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1952dac9-0d3e-455b-bb60-ca5980145381 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:34.961734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:34.964099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1952dac9-0d3e-455b-bb60-ca5980145381 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:34.964551 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1952dac9-0d3e-455b-bb60-ca5980145381 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:34.965349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1952dac9-0d3e-455b-bb60-ca5980145381 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:34.965764 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1952dac9-0d3e-455b-bb60-ca5980145381 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:34.971246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:34.971486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:34.972601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a83897be-b02c-4b4a-bb48-af543eb1f4e7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.157661 May 24 13:00:34.973148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 30/68] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:34 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:35.036723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1952dac9-0d3e-455b-bb60-ca5980145381 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:35.044557 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1952dac9-0d3e-455b-bb60-ca5980145381 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.100231 May 24 13:00:35.045125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 39/69] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:34 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:35.174896 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0153b198-c0da-4b48-98b9-008dbedc0866 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:35.175507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0153b198-c0da-4b48-98b9-008dbedc0866 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:35.181942 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0153b198-c0da-4b48-98b9-008dbedc0866 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:35.182417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0153b198-c0da-4b48-98b9-008dbedc0866 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:35.183178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0153b198-c0da-4b48-98b9-008dbedc0866 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:35.183695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0153b198-c0da-4b48-98b9-008dbedc0866 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:35.318916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0153b198-c0da-4b48-98b9-008dbedc0866 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:35.327244 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0153b198-c0da-4b48-98b9-008dbedc0866 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.156146 May 24 13:00:35.327871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 31/70] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:35 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:35.798885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3c98ed26-0203-47c4-97fe-223f2f44ae05 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:35.799668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3c98ed26-0203-47c4-97fe-223f2f44ae05 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:35.807861 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3c98ed26-0203-47c4-97fe-223f2f44ae05 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:35.808048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3c98ed26-0203-47c4-97fe-223f2f44ae05 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:35.808827 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3c98ed26-0203-47c4-97fe-223f2f44ae05 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:35.809268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3c98ed26-0203-47c4-97fe-223f2f44ae05 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:35.868947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3c98ed26-0203-47c4-97fe-223f2f44ae05 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:35.876528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3c98ed26-0203-47c4-97fe-223f2f44ae05 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.081513 May 24 13:00:35.877098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 40/71] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:35 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:35.990695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:35.991300 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:35.997873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:35.998426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:35.999274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:35.999731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:36.061286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2be23cf6-a0bb-43f6-88f6-e139ef36be6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:36.061908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2be23cf6-a0bb-43f6-88f6-e139ef36be6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:36.068118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2be23cf6-a0bb-43f6-88f6-e139ef36be6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:36.068573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2be23cf6-a0bb-43f6-88f6-e139ef36be6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:36.069362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2be23cf6-a0bb-43f6-88f6-e139ef36be6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:36.069805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2be23cf6-a0bb-43f6-88f6-e139ef36be6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:36.131798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:36.139071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2be23cf6-a0bb-43f6-88f6-e139ef36be6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:36.143153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:36.146791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2be23cf6-a0bb-43f6-88f6-e139ef36be6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.089690 May 24 13:00:36.147367 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 41/72] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:36 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:36.157512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:36.159137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-82eb888e-1e90-4f3b-a610-e2884f6e0d30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.172654 May 24 13:00:36.159717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 32/73] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:35 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:36.344663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dae87917-18df-4018-8044-c0a6e66bc182 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:36.345305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dae87917-18df-4018-8044-c0a6e66bc182 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:36.351567 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dae87917-18df-4018-8044-c0a6e66bc182 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:36.352018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dae87917-18df-4018-8044-c0a6e66bc182 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:36.353519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dae87917-18df-4018-8044-c0a6e66bc182 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:36.353957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dae87917-18df-4018-8044-c0a6e66bc182 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:36.486601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dae87917-18df-4018-8044-c0a6e66bc182 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:36.494954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dae87917-18df-4018-8044-c0a6e66bc182 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.154239 May 24 13:00:36.495510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 42/74] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:36 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:36.892667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a29a4c9-74e7-4ca1-9389-5ad44516ba2f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:36.893316 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a29a4c9-74e7-4ca1-9389-5ad44516ba2f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:36.899550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a29a4c9-74e7-4ca1-9389-5ad44516ba2f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:36.900003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a29a4c9-74e7-4ca1-9389-5ad44516ba2f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:36.900770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a29a4c9-74e7-4ca1-9389-5ad44516ba2f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:36.901208 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a29a4c9-74e7-4ca1-9389-5ad44516ba2f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:36.961935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a29a4c9-74e7-4ca1-9389-5ad44516ba2f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:36.969454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a29a4c9-74e7-4ca1-9389-5ad44516ba2f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.080644 May 24 13:00:36.970014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 33/75] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:36 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:37.163476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c5bc5b5c-0f6f-4f0f-b8df-6e33ac355fbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:37.164081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c5bc5b5c-0f6f-4f0f-b8df-6e33ac355fbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:37.171223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c5bc5b5c-0f6f-4f0f-b8df-6e33ac355fbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:37.171675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c5bc5b5c-0f6f-4f0f-b8df-6e33ac355fbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:37.172561 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c5bc5b5c-0f6f-4f0f-b8df-6e33ac355fbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:37.173066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c5bc5b5c-0f6f-4f0f-b8df-6e33ac355fbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:37.180418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:37.181127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:37.187767 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:37.188209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:37.189304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:37.190086 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:37.241125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c5bc5b5c-0f6f-4f0f-b8df-6e33ac355fbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:37.243726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:37.251090 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c5bc5b5c-0f6f-4f0f-b8df-6e33ac355fbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.091326 May 24 13:00:37.251828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 43/76] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:37 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:37.338165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:37.347891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:37.350183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:37.351859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7d0d0716-5026-4192-977e-4fa06e9896e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.177926 May 24 13:00:37.362447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 34/77] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:37 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:37.512668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-920b21f5-0c00-43a3-b706-02f578087b6d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:37.513295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-920b21f5-0c00-43a3-b706-02f578087b6d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:37.519480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-920b21f5-0c00-43a3-b706-02f578087b6d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:37.519923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-920b21f5-0c00-43a3-b706-02f578087b6d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:37.520676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-920b21f5-0c00-43a3-b706-02f578087b6d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:37.521102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-920b21f5-0c00-43a3-b706-02f578087b6d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:37.645003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-920b21f5-0c00-43a3-b706-02f578087b6d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:37.653218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-920b21f5-0c00-43a3-b706-02f578087b6d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.144485 May 24 13:00:37.653816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 44/78] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:37 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:37.986695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a38c111-ad96-4d6b-85fb-c5fd81177ace tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:37.987359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a38c111-ad96-4d6b-85fb-c5fd81177ace tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:37.993531 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a38c111-ad96-4d6b-85fb-c5fd81177ace tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:37.993985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a38c111-ad96-4d6b-85fb-c5fd81177ace tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:38.002683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a38c111-ad96-4d6b-85fb-c5fd81177ace tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:38.002683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a38c111-ad96-4d6b-85fb-c5fd81177ace tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:38.055298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a38c111-ad96-4d6b-85fb-c5fd81177ace tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:38.062959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a38c111-ad96-4d6b-85fb-c5fd81177ace tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.080176 May 24 13:00:38.063537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 35/79] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:37 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:38.268373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7edad437-a1af-49e5-ad28-002278006f44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:38.269070 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7edad437-a1af-49e5-ad28-002278006f44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:38.275881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7edad437-a1af-49e5-ad28-002278006f44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:38.276324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7edad437-a1af-49e5-ad28-002278006f44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:38.277083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7edad437-a1af-49e5-ad28-002278006f44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:38.277514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7edad437-a1af-49e5-ad28-002278006f44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:38.349227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7edad437-a1af-49e5-ad28-002278006f44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:38.356806 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7edad437-a1af-49e5-ad28-002278006f44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.092172 May 24 13:00:38.357383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 45/80] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:38 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:38.371008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:38.371643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:38.378394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:38.378847 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:38.379610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:38.380044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:38.382659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:38.509475 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:38.514579 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:38.522797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:38.524315 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:38.526012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c8fabbcc-2f93-4350-a27a-71d46318c6b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.159252 May 24 13:00:38.526601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 36/81] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:38 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:38.670681 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0bb94967-ab24-4454-9eec-30280ae50eb2 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:38.671208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0bb94967-ab24-4454-9eec-30280ae50eb2 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:38.677372 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bb94967-ab24-4454-9eec-30280ae50eb2 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:38.677824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bb94967-ab24-4454-9eec-30280ae50eb2 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:38.678612 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bb94967-ab24-4454-9eec-30280ae50eb2 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:38.679049 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bb94967-ab24-4454-9eec-30280ae50eb2 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:38.957228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0bb94967-ab24-4454-9eec-30280ae50eb2 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:38.965119 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0bb94967-ab24-4454-9eec-30280ae50eb2 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.298572 May 24 13:00:38.965679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 46/82] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:38 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:39.078939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a9d607a6-183c-462b-ab0a-354c7b846e09 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:39.079550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a9d607a6-183c-462b-ab0a-354c7b846e09 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:39.081358 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=20 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:39.086866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9d607a6-183c-462b-ab0a-354c7b846e09 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:39.087884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9d607a6-183c-462b-ab0a-354c7b846e09 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:39.088629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9d607a6-183c-462b-ab0a-354c7b846e09 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:39.089063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9d607a6-183c-462b-ab0a-354c7b846e09 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:39.147372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a9d607a6-183c-462b-ab0a-354c7b846e09 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:39.155369 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a9d607a6-183c-462b-ab0a-354c7b846e09 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.080199 May 24 13:00:39.155928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 37/83] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:39 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:39.374504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-aa958981-7162-4c6d-95cc-cd0170621c1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:39.375164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-aa958981-7162-4c6d-95cc-cd0170621c1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:39.377065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:39.382726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa958981-7162-4c6d-95cc-cd0170621c1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:39.383182 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa958981-7162-4c6d-95cc-cd0170621c1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:39.384444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa958981-7162-4c6d-95cc-cd0170621c1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:39.384884 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa958981-7162-4c6d-95cc-cd0170621c1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:39.444479 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-aa958981-7162-4c6d-95cc-cd0170621c1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:39.452965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-aa958981-7162-4c6d-95cc-cd0170621c1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.082733 May 24 13:00:39.453574 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 47/84] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:39 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:39.543548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:39.544226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:39.550058 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:39.550539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:39.551344 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:39.551868 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:39.677964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:39.685831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:39.687401 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:39.688494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-107543ee-e2b1-404c-b379-d33c7dde19af tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.148919 May 24 13:00:39.689053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 38/85] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:39 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:39.980745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6aa741b5-6d1f-404b-8d08-80f404639c2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:39.981361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6aa741b5-6d1f-404b-8d08-80f404639c2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:39.987463 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6aa741b5-6d1f-404b-8d08-80f404639c2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:39.987912 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6aa741b5-6d1f-404b-8d08-80f404639c2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:39.988672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6aa741b5-6d1f-404b-8d08-80f404639c2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:39.989107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6aa741b5-6d1f-404b-8d08-80f404639c2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:40.114776 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6aa741b5-6d1f-404b-8d08-80f404639c2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:40.122147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6aa741b5-6d1f-404b-8d08-80f404639c2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.145212 May 24 13:00:40.123005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 48/86] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:39 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:40.171621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0e8117c8-5b88-4dd8-a7a7-c88ca572cf17 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:40.172242 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0e8117c8-5b88-4dd8-a7a7-c88ca572cf17 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:40.178362 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e8117c8-5b88-4dd8-a7a7-c88ca572cf17 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:40.178816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e8117c8-5b88-4dd8-a7a7-c88ca572cf17 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:40.179607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e8117c8-5b88-4dd8-a7a7-c88ca572cf17 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:40.180045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e8117c8-5b88-4dd8-a7a7-c88ca572cf17 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:40.238474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0e8117c8-5b88-4dd8-a7a7-c88ca572cf17 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:40.246201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0e8117c8-5b88-4dd8-a7a7-c88ca572cf17 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.078392 May 24 13:00:40.246783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 39/87] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:40 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:40.468961 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bd39f996-c414-4a52-bcfb-7532994949f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:40.471273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bd39f996-c414-4a52-bcfb-7532994949f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:40.477835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd39f996-c414-4a52-bcfb-7532994949f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:40.478297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd39f996-c414-4a52-bcfb-7532994949f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:40.479079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd39f996-c414-4a52-bcfb-7532994949f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:40.479513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd39f996-c414-4a52-bcfb-7532994949f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:40.539330 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bd39f996-c414-4a52-bcfb-7532994949f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:40.547455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bd39f996-c414-4a52-bcfb-7532994949f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.082385 May 24 13:00:40.548025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 49/88] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:40 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:40.706078 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:40.706727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:40.713310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:40.713761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:40.714538 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:40.714972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:40.845499 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:40.853483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:40.855032 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:40.856123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ae72aecf-5734-43ae-b212-69d760d5b9b5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.153971 May 24 13:00:40.856674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 40/89] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:40 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:41.139875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-72ce67a7-40c0-4030-b33e-755088546369 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:41.140495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-72ce67a7-40c0-4030-b33e-755088546369 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:41.146581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-72ce67a7-40c0-4030-b33e-755088546369 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:41.147038 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-72ce67a7-40c0-4030-b33e-755088546369 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:41.147805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-72ce67a7-40c0-4030-b33e-755088546369 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:41.148248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-72ce67a7-40c0-4030-b33e-755088546369 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:41.263952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-74f34bbd-8594-46a8-bc9d-92e5347ac2cc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:41.264666 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-74f34bbd-8594-46a8-bc9d-92e5347ac2cc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:41.270637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74f34bbd-8594-46a8-bc9d-92e5347ac2cc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:41.271083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74f34bbd-8594-46a8-bc9d-92e5347ac2cc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:41.271838 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74f34bbd-8594-46a8-bc9d-92e5347ac2cc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:41.271948 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-72ce67a7-40c0-4030-b33e-755088546369 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:41.272265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74f34bbd-8594-46a8-bc9d-92e5347ac2cc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:41.279323 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-72ce67a7-40c0-4030-b33e-755088546369 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.143352 May 24 13:00:41.288409 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 50/90] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:41 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:41.334582 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-74f34bbd-8594-46a8-bc9d-92e5347ac2cc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:41.342080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-74f34bbd-8594-46a8-bc9d-92e5347ac2cc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.082180 May 24 13:00:41.342669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 41/91] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:41 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:41.564249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1004b94b-74ec-4607-b558-e8b6baa01711 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:41.564862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1004b94b-74ec-4607-b558-e8b6baa01711 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:41.570903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1004b94b-74ec-4607-b558-e8b6baa01711 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:41.571352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1004b94b-74ec-4607-b558-e8b6baa01711 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:41.572118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1004b94b-74ec-4607-b558-e8b6baa01711 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:41.572556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1004b94b-74ec-4607-b558-e8b6baa01711 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:41.634507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1004b94b-74ec-4607-b558-e8b6baa01711 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:41.641925 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1004b94b-74ec-4607-b558-e8b6baa01711 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.081535 May 24 13:00:41.642513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 51/92] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:41 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:41.873552 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:41.874155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:41.880304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:41.880752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:41.881514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:41.881984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:42.007983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:42.015893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:42.017424 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:42.018554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-98ccd922-7c45-4b71-b258-36d55c1ac45f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.149040 May 24 13:00:42.019193 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 42/93] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:41 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:42.296537 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fad0f77a-b2f1-4cc7-bb1b-8d8c09712bf3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:42.297078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fad0f77a-b2f1-4cc7-bb1b-8d8c09712bf3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:42.303244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fad0f77a-b2f1-4cc7-bb1b-8d8c09712bf3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:42.304872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fad0f77a-b2f1-4cc7-bb1b-8d8c09712bf3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:42.304872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fad0f77a-b2f1-4cc7-bb1b-8d8c09712bf3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:42.304872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fad0f77a-b2f1-4cc7-bb1b-8d8c09712bf3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:42.359690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-91456264-96ee-4cd3-99e1-2865d3c9894b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:42.360312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-91456264-96ee-4cd3-99e1-2865d3c9894b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:42.366473 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91456264-96ee-4cd3-99e1-2865d3c9894b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:42.366925 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91456264-96ee-4cd3-99e1-2865d3c9894b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:42.367689 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91456264-96ee-4cd3-99e1-2865d3c9894b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:42.368688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91456264-96ee-4cd3-99e1-2865d3c9894b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:42.433337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-91456264-96ee-4cd3-99e1-2865d3c9894b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:42.440608 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-91456264-96ee-4cd3-99e1-2865d3c9894b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.085207 May 24 13:00:42.441160 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 43/94] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:42 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:42.451847 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-fad0f77a-b2f1-4cc7-bb1b-8d8c09712bf3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:42.459362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fad0f77a-b2f1-4cc7-bb1b-8d8c09712bf3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.166754 May 24 13:00:42.459933 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 52/95] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:42 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:42.659911 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1f0efce7-a167-4a34-a054-4e8ee7454559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:42.660586 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1f0efce7-a167-4a34-a054-4e8ee7454559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:42.667293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f0efce7-a167-4a34-a054-4e8ee7454559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:42.667741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f0efce7-a167-4a34-a054-4e8ee7454559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:42.668520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f0efce7-a167-4a34-a054-4e8ee7454559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:42.669141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f0efce7-a167-4a34-a054-4e8ee7454559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:42.735507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1f0efce7-a167-4a34-a054-4e8ee7454559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:42.744913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1f0efce7-a167-4a34-a054-4e8ee7454559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.089025 May 24 13:00:42.745493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 44/96] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:42 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:43.036246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:43.036868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:43.043434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:43.043895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:43.044993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:43.045436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:43.168377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:43.176311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:43.177832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:43.178967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b74783dd-cfc8-4785-9332-38cb2ae307f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.146611 May 24 13:00:43.179528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 53/97] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:43 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:43.456867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9679190d-a2a8-4f39-8f81-ac22bd32c242 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:43.457396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9679190d-a2a8-4f39-8f81-ac22bd32c242 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:43.463533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9679190d-a2a8-4f39-8f81-ac22bd32c242 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:43.463979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9679190d-a2a8-4f39-8f81-ac22bd32c242 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:43.464733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9679190d-a2a8-4f39-8f81-ac22bd32c242 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:43.465164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9679190d-a2a8-4f39-8f81-ac22bd32c242 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:43.476253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5a93ddf6-1783-44fd-abfd-c0cef3b85db3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:43.476865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5a93ddf6-1783-44fd-abfd-c0cef3b85db3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:43.482827 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a93ddf6-1783-44fd-abfd-c0cef3b85db3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:43.483274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a93ddf6-1783-44fd-abfd-c0cef3b85db3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:43.484026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a93ddf6-1783-44fd-abfd-c0cef3b85db3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:43.484461 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a93ddf6-1783-44fd-abfd-c0cef3b85db3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:43.525175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9679190d-a2a8-4f39-8f81-ac22bd32c242 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:43.532685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9679190d-a2a8-4f39-8f81-ac22bd32c242 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.079700 May 24 13:00:43.533369 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 45/98] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:43 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:43.613647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5a93ddf6-1783-44fd-abfd-c0cef3b85db3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:43.621051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5a93ddf6-1783-44fd-abfd-c0cef3b85db3 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.148564 May 24 13:00:43.621610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 54/99] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:43 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:43.761550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e24f51a-ba26-4cf9-87b1-7d2aa6dd80ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:43.762161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e24f51a-ba26-4cf9-87b1-7d2aa6dd80ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:43.768138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e24f51a-ba26-4cf9-87b1-7d2aa6dd80ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:43.768583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e24f51a-ba26-4cf9-87b1-7d2aa6dd80ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:43.769339 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e24f51a-ba26-4cf9-87b1-7d2aa6dd80ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:43.769772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e24f51a-ba26-4cf9-87b1-7d2aa6dd80ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:43.830685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e24f51a-ba26-4cf9-87b1-7d2aa6dd80ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:43.838610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e24f51a-ba26-4cf9-87b1-7d2aa6dd80ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.081309 May 24 13:00:43.839176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 46/100] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:43 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:44.197580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:44.198373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:44.204740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:44.205266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:44.206123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:44.206584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:44.329958 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:44.338024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:44.339558 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:44.340650 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6fba1bac-5443-42cb-9576-97d07a6307dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.147650 May 24 13:00:44.341248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 55/101] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:44 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:44.549175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-199be475-cab7-4fcd-a59a-f649a8580c42 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:44.549740 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-199be475-cab7-4fcd-a59a-f649a8580c42 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:44.556344 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199be475-cab7-4fcd-a59a-f649a8580c42 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:44.556794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199be475-cab7-4fcd-a59a-f649a8580c42 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:44.557553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199be475-cab7-4fcd-a59a-f649a8580c42 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:44.557987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199be475-cab7-4fcd-a59a-f649a8580c42 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:44.617737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-199be475-cab7-4fcd-a59a-f649a8580c42 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:44.625425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-199be475-cab7-4fcd-a59a-f649a8580c42 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.080197 May 24 13:00:44.625991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 47/102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:44 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:44.638164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5651c4c7-800c-48d9-b374-f3b81d45dc2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:44.638826 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5651c4c7-800c-48d9-b374-f3b81d45dc2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:44.644839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5651c4c7-800c-48d9-b374-f3b81d45dc2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:44.645303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5651c4c7-800c-48d9-b374-f3b81d45dc2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:44.646067 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5651c4c7-800c-48d9-b374-f3b81d45dc2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:44.646543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5651c4c7-800c-48d9-b374-f3b81d45dc2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:44.775734 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5651c4c7-800c-48d9-b374-f3b81d45dc2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:44.783138 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5651c4c7-800c-48d9-b374-f3b81d45dc2d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.149219 May 24 13:00:44.783705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 56/103] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:44 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:44.855018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c6daccac-0449-4710-9ee9-2f5df02cd824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:44.855629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c6daccac-0449-4710-9ee9-2f5df02cd824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:44.861556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c6daccac-0449-4710-9ee9-2f5df02cd824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:44.862003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c6daccac-0449-4710-9ee9-2f5df02cd824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:44.862790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c6daccac-0449-4710-9ee9-2f5df02cd824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:44.863233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c6daccac-0449-4710-9ee9-2f5df02cd824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:44.921235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c6daccac-0449-4710-9ee9-2f5df02cd824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:44.928427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c6daccac-0449-4710-9ee9-2f5df02cd824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.077192 May 24 13:00:44.928987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 48/104] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:44 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:45.366702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:45.367324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:45.374153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:45.374628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:45.375385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:45.375815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:45.501650 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:45.510089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:45.511649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:45.512793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-754e7ea3-bd4d-4e96-8b7a-379e9ba3f5f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.149914 May 24 13:00:45.513340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 57/105] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:45 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:45.642404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cb65f2d7-3702-4066-ac50-71da19910f66 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:45.642944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cb65f2d7-3702-4066-ac50-71da19910f66 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:45.648929 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb65f2d7-3702-4066-ac50-71da19910f66 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:45.649420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb65f2d7-3702-4066-ac50-71da19910f66 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:45.650172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb65f2d7-3702-4066-ac50-71da19910f66 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:45.650626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb65f2d7-3702-4066-ac50-71da19910f66 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:45.708683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cb65f2d7-3702-4066-ac50-71da19910f66 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:45.715976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cb65f2d7-3702-4066-ac50-71da19910f66 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.077476 May 24 13:00:45.716537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 49/106] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:45 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:45.799555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-049a009f-1a7a-49d2-bea9-0d9b67f5dcd9 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:45.800191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-049a009f-1a7a-49d2-bea9-0d9b67f5dcd9 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:45.806959 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-049a009f-1a7a-49d2-bea9-0d9b67f5dcd9 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:45.807450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-049a009f-1a7a-49d2-bea9-0d9b67f5dcd9 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:45.808215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-049a009f-1a7a-49d2-bea9-0d9b67f5dcd9 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:45.808680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-049a009f-1a7a-49d2-bea9-0d9b67f5dcd9 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:45.932944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-049a009f-1a7a-49d2-bea9-0d9b67f5dcd9 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:45.940504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-049a009f-1a7a-49d2-bea9-0d9b67f5dcd9 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.144762 May 24 13:00:45.941243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 58/107] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:45 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:45.944643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-04955c12-376e-4314-ae09-80c493e0665f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:45.945247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-04955c12-376e-4314-ae09-80c493e0665f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:45.951249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04955c12-376e-4314-ae09-80c493e0665f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:45.951712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04955c12-376e-4314-ae09-80c493e0665f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:45.952461 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04955c12-376e-4314-ae09-80c493e0665f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:45.952895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04955c12-376e-4314-ae09-80c493e0665f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:46.014056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-04955c12-376e-4314-ae09-80c493e0665f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:46.021254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-04955c12-376e-4314-ae09-80c493e0665f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1234 microversion: 2.1 time: 0.080346 May 24 13:00:46.022000 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 50/108] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:45 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1234 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:46.531312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:46.531984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:46.538127 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:46.538601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:46.539354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:46.539856 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:46.671143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:46.681705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:46.683994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:46.687020 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-43e6f5ab-1af7-4145-b384-977f4d86348d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.159727 May 24 13:00:46.687587 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 59/109] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:46 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:46.732234 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e2d291e6-d2c3-4861-8fbe-bbc6218b1a5d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:46.732883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e2d291e6-d2c3-4861-8fbe-bbc6218b1a5d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:46.739063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2d291e6-d2c3-4861-8fbe-bbc6218b1a5d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:46.739514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2d291e6-d2c3-4861-8fbe-bbc6218b1a5d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:46.740273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2d291e6-d2c3-4861-8fbe-bbc6218b1a5d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:46.740710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2d291e6-d2c3-4861-8fbe-bbc6218b1a5d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:46.799675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e2d291e6-d2c3-4861-8fbe-bbc6218b1a5d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:46.807021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e2d291e6-d2c3-4861-8fbe-bbc6218b1a5d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1226 microversion: 2.1 time: 0.078614 May 24 13:00:46.807599 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 51/110] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:46 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:46.957169 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d4e08fdb-79c5-4b8b-8f46-c1323605627c tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:46.957713 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d4e08fdb-79c5-4b8b-8f46-c1323605627c tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:46.971478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4e08fdb-79c5-4b8b-8f46-c1323605627c tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:46.971952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4e08fdb-79c5-4b8b-8f46-c1323605627c tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:46.972737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4e08fdb-79c5-4b8b-8f46-c1323605627c tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:46.973176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4e08fdb-79c5-4b8b-8f46-c1323605627c tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:46.990711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:47.037727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca59d629-aa03-4a96-abac-1d2361eca970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:47.038573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ca59d629-aa03-4a96-abac-1d2361eca970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:47.045150 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca59d629-aa03-4a96-abac-1d2361eca970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:47.045602 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca59d629-aa03-4a96-abac-1d2361eca970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:47.046395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca59d629-aa03-4a96-abac-1d2361eca970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:47.046837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca59d629-aa03-4a96-abac-1d2361eca970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:47.116535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ca59d629-aa03-4a96-abac-1d2361eca970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:47.118786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:47.127450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ca59d629-aa03-4a96-abac-1d2361eca970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1290 microversion: 2.1 time: 0.093308 May 24 13:00:47.137161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 52/111] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:47 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:47.351122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d4e08fdb-79c5-4b8b-8f46-c1323605627c tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:47.370587 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d4e08fdb-79c5-4b8b-8f46-c1323605627c tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.411997 May 24 13:00:47.374128 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 60/112] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:46 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:47.658019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-ec5188d0-3460-4eea-bfcb-47bd24be873c req-37c8a170-1fc3-4f36-9e60-dbdf86fbbbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f71a38-48c3-4411-98c8-00beab5f55b3", "name": "network-vif-plugged", "status": "completed", "tag": "cf875030-2a08-4025-876f-dccb6cfa7b28"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:47.680593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ec5188d0-3460-4eea-bfcb-47bd24be873c req-37c8a170-1fc3-4f36-9e60-dbdf86fbbbf7 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:47.681097 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ec5188d0-3460-4eea-bfcb-47bd24be873c req-37c8a170-1fc3-4f36-9e60-dbdf86fbbbf7 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:47.707839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:47.708452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:47.716170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:47.720432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:47.721602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:47.723499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:47.733513 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-ec5188d0-3460-4eea-bfcb-47bd24be873c req-37c8a170-1fc3-4f36-9e60-dbdf86fbbbf7 service nova] Creating event network-vif-plugged:cf875030-2a08-4025-876f-dccb6cfa7b28 for instance a5f71a38-48c3-4411-98c8-00beab5f55b3 on hv-cinder-84301 May 24 13:00:47.734033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ec5188d0-3460-4eea-bfcb-47bd24be873c req-37c8a170-1fc3-4f36-9e60-dbdf86fbbbf7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 13:00:47.735167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367bd1c7-8557-411b-b157-a74754e0b784 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:47.735605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367bd1c7-8557-411b-b157-a74754e0b784 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:47.736381 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367bd1c7-8557-411b-b157-a74754e0b784 None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:47.736803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367bd1c7-8557-411b-b157-a74754e0b784 None None] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:47.745948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.compute.rpcapi [None req-367bd1c7-8557-411b-b157-a74754e0b784 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 13:00:47.747068 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367bd1c7-8557-411b-b157-a74754e0b784 None None] Releasing lock "compute-rpcapi-router" {{(pid=117642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 13:00:47.775591 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-367bd1c7-8557-411b-b157-a74754e0b784 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188090 May 24 13:00:47.776445 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 53/113] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:47.826999 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-91c4ed17-ef67-4c3f-955a-90eb23451ac2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:47.828179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-91c4ed17-ef67-4c3f-955a-90eb23451ac2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:47.849133 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91c4ed17-ef67-4c3f-955a-90eb23451ac2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:47.850505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91c4ed17-ef67-4c3f-955a-90eb23451ac2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:47.851607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91c4ed17-ef67-4c3f-955a-90eb23451ac2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:47.852263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91c4ed17-ef67-4c3f-955a-90eb23451ac2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:48.284117 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-91c4ed17-ef67-4c3f-955a-90eb23451ac2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:48.302638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-91c4ed17-ef67-4c3f-955a-90eb23451ac2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1282 microversion: 2.1 time: 0.482681 May 24 13:00:48.304676 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 54/114] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:47 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1282 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:48.330022 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ed2f659a-137b-48ef-be7f-0935026679f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:48.330821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ed2f659a-137b-48ef-be7f-0935026679f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:48.358654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:48.366407 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed2f659a-137b-48ef-be7f-0935026679f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:48.371691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed2f659a-137b-48ef-be7f-0935026679f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:48.377891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed2f659a-137b-48ef-be7f-0935026679f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:48.380038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed2f659a-137b-48ef-be7f-0935026679f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:48.536231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:48.550899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:48.556722 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:48.559782 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7cf15d94-ecd2-4a71-8a7a-27487d00a0d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.855679 May 24 13:00:48.562707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 61/115] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:47 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:00:48.570465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a3343be3-3940-4d67-bcb6-26fe010175ad tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:48.572898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a3343be3-3940-4d67-bcb6-26fe010175ad tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:48.576371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ed2f659a-137b-48ef-be7f-0935026679f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:48.584515 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a3343be3-3940-4d67-bcb6-26fe010175ad tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:48.584969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a3343be3-3940-4d67-bcb6-26fe010175ad tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:48.585754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a3343be3-3940-4d67-bcb6-26fe010175ad tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:48.586191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a3343be3-3940-4d67-bcb6-26fe010175ad tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:48.586350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ed2f659a-137b-48ef-be7f-0935026679f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1296 microversion: 2.1 time: 0.279559 May 24 13:00:48.587618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 55/116] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:48 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1296 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:49.063237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a3343be3-3940-4d67-bcb6-26fe010175ad tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:49.076306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a3343be3-3940-4d67-bcb6-26fe010175ad tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.510534 May 24 13:00:49.077210 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 62/117] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:48 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:49.323237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1c7f6192-cf3b-4308-ab04-2e88f13b9e28 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:49.323955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1c7f6192-cf3b-4308-ab04-2e88f13b9e28 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:49.334247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c7f6192-cf3b-4308-ab04-2e88f13b9e28 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:49.335006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c7f6192-cf3b-4308-ab04-2e88f13b9e28 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:49.336005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c7f6192-cf3b-4308-ab04-2e88f13b9e28 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:49.337919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c7f6192-cf3b-4308-ab04-2e88f13b9e28 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:49.345080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-3c930ee0-b3ec-41cb-98a6-98aeae116981 req-ecc44c42-337f-415c-9321-1b3f771ec98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dbd25ed-5661-4c08-949c-27204c6c1172", "tag": "d4232814-2adb-4fc6-bd44-4cb7c7da4de1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:49.362012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-3c930ee0-b3ec-41cb-98a6-98aeae116981 req-ecc44c42-337f-415c-9321-1b3f771ec98d service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:49.362577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-3c930ee0-b3ec-41cb-98a6-98aeae116981 req-ecc44c42-337f-415c-9321-1b3f771ec98d service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:49.384218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-3c930ee0-b3ec-41cb-98a6-98aeae116981 req-ecc44c42-337f-415c-9321-1b3f771ec98d service nova] Creating event network-changed:d4232814-2adb-4fc6-bd44-4cb7c7da4de1 for instance 8dbd25ed-5661-4c08-949c-27204c6c1172 on hv-cinder-84301 May 24 13:00:49.389971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-3c930ee0-b3ec-41cb-98a6-98aeae116981 req-ecc44c42-337f-415c-9321-1b3f771ec98d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120636 May 24 13:00:49.397699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 56/118] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:49.581063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:49.581774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:49.588966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:49.589936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:49.590924 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:49.591359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:49.648822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1c7f6192-cf3b-4308-ab04-2e88f13b9e28 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:49.656795 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1c7f6192-cf3b-4308-ab04-2e88f13b9e28 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1280 microversion: 2.1 time: 0.339582 May 24 13:00:49.657363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 63/119] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:49 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1280 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:49.661974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3d2c2979-1052-4c16-bf5b-a082767b258d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:49.662600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3d2c2979-1052-4c16-bf5b-a082767b258d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:49.668952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d2c2979-1052-4c16-bf5b-a082767b258d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:49.669578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d2c2979-1052-4c16-bf5b-a082767b258d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:49.670365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d2c2979-1052-4c16-bf5b-a082767b258d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:49.670800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d2c2979-1052-4c16-bf5b-a082767b258d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:49.738726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:49.747646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:49.749169 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:49.750428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-064a4600-1bbf-40c5-9859-17d629af5c9e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.174799 May 24 13:00:49.750974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 57/120] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:49 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:00:49.847569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3d2c2979-1052-4c16-bf5b-a082767b258d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:49.855819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3d2c2979-1052-4c16-bf5b-a082767b258d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.197337 May 24 13:00:49.856390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 64/121] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:49 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:50.093356 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f49a2cfc-be89-4917-845d-ec75c4e0d058 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:50.093909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f49a2cfc-be89-4917-845d-ec75c4e0d058 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:50.100053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f49a2cfc-be89-4917-845d-ec75c4e0d058 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:50.100506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f49a2cfc-be89-4917-845d-ec75c4e0d058 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:50.101264 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f49a2cfc-be89-4917-845d-ec75c4e0d058 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:50.101700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f49a2cfc-be89-4917-845d-ec75c4e0d058 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:50.234859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f49a2cfc-be89-4917-845d-ec75c4e0d058 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:50.242202 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f49a2cfc-be89-4917-845d-ec75c4e0d058 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.152663 May 24 13:00:50.242807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 58/122] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:50 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:50.674143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c1590974-512f-4715-b2c3-84546e93d34a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:50.674697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c1590974-512f-4715-b2c3-84546e93d34a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:50.681440 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1590974-512f-4715-b2c3-84546e93d34a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:50.681889 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1590974-512f-4715-b2c3-84546e93d34a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:50.682677 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1590974-512f-4715-b2c3-84546e93d34a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:50.683113 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1590974-512f-4715-b2c3-84546e93d34a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:50.768087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:50.768696 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:50.774803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:50.775248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:50.776008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:50.776442 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:50.815616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c1590974-512f-4715-b2c3-84546e93d34a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:50.823770 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c1590974-512f-4715-b2c3-84546e93d34a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.153467 May 24 13:00:50.824352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 65/123] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:50 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:50.873205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8f856a6d-219e-4d85-b527-9eae97bcd81d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:50.873822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8f856a6d-219e-4d85-b527-9eae97bcd81d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:50.880005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f856a6d-219e-4d85-b527-9eae97bcd81d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:50.880455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f856a6d-219e-4d85-b527-9eae97bcd81d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:50.881224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f856a6d-219e-4d85-b527-9eae97bcd81d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:50.881661 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f856a6d-219e-4d85-b527-9eae97bcd81d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:50.904028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:50.911922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:50.913410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:50.914517 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-00b6403f-48d9-4335-85a3-7ed2576638a0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.150253 May 24 13:00:50.915072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 59/124] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:50 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:00:51.006107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8f856a6d-219e-4d85-b527-9eae97bcd81d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:51.014075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8f856a6d-219e-4d85-b527-9eae97bcd81d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.144945 May 24 13:00:51.014674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 66/125] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:50 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:51.260136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8a35f0ba-1822-4658-9556-1d2dd07b955d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:51.260746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8a35f0ba-1822-4658-9556-1d2dd07b955d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:51.266742 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a35f0ba-1822-4658-9556-1d2dd07b955d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:51.267186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a35f0ba-1822-4658-9556-1d2dd07b955d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:51.267940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a35f0ba-1822-4658-9556-1d2dd07b955d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:51.268372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a35f0ba-1822-4658-9556-1d2dd07b955d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:51.412043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8a35f0ba-1822-4658-9556-1d2dd07b955d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:51.412344 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-31109f07-5299-4b92-b570-43c2bd4f6e9e req-52b91fd4-b4f8-4ee7-be41-42cb4736f1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfc07c6-54c6-40b9-83bb-0343afadb737", "tag": "e281dabe-d4a2-4efa-97d5-a1ac6bcb3589"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:51.420280 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8a35f0ba-1822-4658-9556-1d2dd07b955d tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.163941 May 24 13:00:51.420849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 60/126] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:51 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:51.420990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-31109f07-5299-4b92-b570-43c2bd4f6e9e req-52b91fd4-b4f8-4ee7-be41-42cb4736f1a0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:51.421430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-31109f07-5299-4b92-b570-43c2bd4f6e9e req-52b91fd4-b4f8-4ee7-be41-42cb4736f1a0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:51.432200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-31109f07-5299-4b92-b570-43c2bd4f6e9e req-52b91fd4-b4f8-4ee7-be41-42cb4736f1a0 service nova] Creating event network-changed:e281dabe-d4a2-4efa-97d5-a1ac6bcb3589 for instance ecfc07c6-54c6-40b9-83bb-0343afadb737 on hv-cinder-84301 May 24 13:00:51.436991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-31109f07-5299-4b92-b570-43c2bd4f6e9e req-52b91fd4-b4f8-4ee7-be41-42cb4736f1a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028264 May 24 13:00:51.437560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 67/127] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:00:51.839939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-efd17a2a-e914-405c-b330-ba4d83e30d9e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:51.840538 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-efd17a2a-e914-405c-b330-ba4d83e30d9e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:51.846559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efd17a2a-e914-405c-b330-ba4d83e30d9e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:51.847009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efd17a2a-e914-405c-b330-ba4d83e30d9e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:51.847765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efd17a2a-e914-405c-b330-ba4d83e30d9e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:51.848199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efd17a2a-e914-405c-b330-ba4d83e30d9e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:51.933229 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:51.933920 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:51.940121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:51.940561 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:51.941344 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:51.941775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:51.972952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-efd17a2a-e914-405c-b330-ba4d83e30d9e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:51.981104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-efd17a2a-e914-405c-b330-ba4d83e30d9e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.145020 May 24 13:00:51.981676 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 61/128] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:51 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:52.030645 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-70666e4b-4b0c-4798-8e97-a3eeb037db9f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:52.031258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-70666e4b-4b0c-4798-8e97-a3eeb037db9f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:52.037228 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70666e4b-4b0c-4798-8e97-a3eeb037db9f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:52.037680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70666e4b-4b0c-4798-8e97-a3eeb037db9f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:52.038483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70666e4b-4b0c-4798-8e97-a3eeb037db9f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:52.038919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70666e4b-4b0c-4798-8e97-a3eeb037db9f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:52.067428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:52.076063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:52.077793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:52.078922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-35dd3d5f-feff-426f-ab94-ea3970abf4e2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.150539 May 24 13:00:52.079645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 68/129] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:51 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:00:52.169741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-70666e4b-4b0c-4798-8e97-a3eeb037db9f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:52.177213 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-70666e4b-4b0c-4798-8e97-a3eeb037db9f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.150371 May 24 13:00:52.177772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 62/130] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:52 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:52.437307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8d42ca39-3f4d-45ae-9fc4-358236dcef58 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:52.437921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8d42ca39-3f4d-45ae-9fc4-358236dcef58 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:52.444010 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d42ca39-3f4d-45ae-9fc4-358236dcef58 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:52.444457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d42ca39-3f4d-45ae-9fc4-358236dcef58 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:52.445213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d42ca39-3f4d-45ae-9fc4-358236dcef58 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:52.445644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d42ca39-3f4d-45ae-9fc4-358236dcef58 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:52.584221 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8d42ca39-3f4d-45ae-9fc4-358236dcef58 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:52.591777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8d42ca39-3f4d-45ae-9fc4-358236dcef58 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.158341 May 24 13:00:52.592324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 69/131] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:52 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:52.997912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-39110e5f-97af-4b78-8b15-e8733fca3f93 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:52.998493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-39110e5f-97af-4b78-8b15-e8733fca3f93 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:53.004526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39110e5f-97af-4b78-8b15-e8733fca3f93 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:53.004971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39110e5f-97af-4b78-8b15-e8733fca3f93 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:53.005719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39110e5f-97af-4b78-8b15-e8733fca3f93 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:53.006166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39110e5f-97af-4b78-8b15-e8733fca3f93 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:53.096939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:53.097545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:53.103663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:53.104235 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:53.104875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:53.105295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:53.135451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-39110e5f-97af-4b78-8b15-e8733fca3f93 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:53.142947 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-39110e5f-97af-4b78-8b15-e8733fca3f93 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.149147 May 24 13:00:53.143511 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 63/132] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:52 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:53.194223 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6424aa89-2906-47bd-a799-a73c5a8d083f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:53.194902 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6424aa89-2906-47bd-a799-a73c5a8d083f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:53.203540 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6424aa89-2906-47bd-a799-a73c5a8d083f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:53.203991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6424aa89-2906-47bd-a799-a73c5a8d083f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:53.205372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6424aa89-2906-47bd-a799-a73c5a8d083f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:53.205809 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6424aa89-2906-47bd-a799-a73c5a8d083f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:53.257944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:53.266644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:53.268188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:53.269625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7cac278c-10d7-43e7-a465-0d85fe1b8ddf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.176494 May 24 13:00:53.270191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 70/133] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:53 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:00:53.358470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6424aa89-2906-47bd-a799-a73c5a8d083f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:53.367167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6424aa89-2906-47bd-a799-a73c5a8d083f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.176957 May 24 13:00:53.367994 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 64/134] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:53 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:53.608413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-248291c2-5adf-46b1-8f01-f985aa187d82 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:53.609181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-248291c2-5adf-46b1-8f01-f985aa187d82 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:53.617701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-248291c2-5adf-46b1-8f01-f985aa187d82 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:53.618259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-248291c2-5adf-46b1-8f01-f985aa187d82 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:53.619159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-248291c2-5adf-46b1-8f01-f985aa187d82 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:53.619745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-248291c2-5adf-46b1-8f01-f985aa187d82 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:53.921397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-248291c2-5adf-46b1-8f01-f985aa187d82 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:53.931183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-248291c2-5adf-46b1-8f01-f985aa187d82 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.326498 May 24 13:00:53.932011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 71/135] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:53 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:54.166917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d24844e0-02c0-4cbe-99a9-73d855858b38 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:54.168255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d24844e0-02c0-4cbe-99a9-73d855858b38 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:54.186327 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d24844e0-02c0-4cbe-99a9-73d855858b38 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:54.186812 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d24844e0-02c0-4cbe-99a9-73d855858b38 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:54.187913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d24844e0-02c0-4cbe-99a9-73d855858b38 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:54.188419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d24844e0-02c0-4cbe-99a9-73d855858b38 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:54.290970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:54.291601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:54.297846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:54.298505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:54.299477 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:54.300077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:54.654899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d24844e0-02c0-4cbe-99a9-73d855858b38 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:54.672677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d24844e0-02c0-4cbe-99a9-73d855858b38 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.515244 May 24 13:00:54.674936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 65/136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:54 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:54.682954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-8cded3b8-67ed-4bcb-a834-f14173527bae req-2df14d1b-d2ae-4a7c-bca8-878ae0347221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6db3c9-4cac-4157-ba43-3c425854302d", "tag": "59643b71-d317-4922-9d19-0298524e0346"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:54.704559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8cded3b8-67ed-4bcb-a834-f14173527bae req-2df14d1b-d2ae-4a7c-bca8-878ae0347221 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:54.707572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8cded3b8-67ed-4bcb-a834-f14173527bae req-2df14d1b-d2ae-4a7c-bca8-878ae0347221 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:54.733725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-8cded3b8-67ed-4bcb-a834-f14173527bae req-2df14d1b-d2ae-4a7c-bca8-878ae0347221 service nova] Creating event network-changed:59643b71-d317-4922-9d19-0298524e0346 for instance dc6db3c9-4cac-4157-ba43-3c425854302d on hv-cinder-84301 May 24 13:00:54.743437 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-8cded3b8-67ed-4bcb-a834-f14173527bae req-2df14d1b-d2ae-4a7c-bca8-878ae0347221 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065246 May 24 13:00:54.744231 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 66/137] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:00:54.752352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5b396f60-14e4-4e9e-9172-50cb1c258faf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:54.754164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5b396f60-14e4-4e9e-9172-50cb1c258faf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:54.763562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b396f60-14e4-4e9e-9172-50cb1c258faf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:54.764225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b396f60-14e4-4e9e-9172-50cb1c258faf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:54.765358 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b396f60-14e4-4e9e-9172-50cb1c258faf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:54.765941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b396f60-14e4-4e9e-9172-50cb1c258faf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:54.958822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:54.969883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:54.978245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:54.986512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-59134669-511f-49ce-9b38-ae159569666f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.701203 May 24 13:00:54.997557 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5b396f60-14e4-4e9e-9172-50cb1c258faf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:54.999130 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 72/138] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:54 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:00:54.999761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5b396f60-14e4-4e9e-9172-50cb1c258faf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.254585 May 24 13:00:55.002325 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 67/139] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:54 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:55.013746 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-eb3aeacb-9634-4e4c-851d-9a16bf32ab3a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:55.014742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-eb3aeacb-9634-4e4c-851d-9a16bf32ab3a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:55.020937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:55.031309 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb3aeacb-9634-4e4c-851d-9a16bf32ab3a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:55.031764 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb3aeacb-9634-4e4c-851d-9a16bf32ab3a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:55.032682 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb3aeacb-9634-4e4c-851d-9a16bf32ab3a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:55.032954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb3aeacb-9634-4e4c-851d-9a16bf32ab3a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:55.669683 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-eb3aeacb-9634-4e4c-851d-9a16bf32ab3a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:55.679012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-eb3aeacb-9634-4e4c-851d-9a16bf32ab3a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1314 microversion: 2.1 time: 0.678457 May 24 13:00:55.680697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 73/140] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:54 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:55.694120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3aab91ab-1368-45a2-aeb5-486ae74ce2c0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:55.695934 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3aab91ab-1368-45a2-aeb5-486ae74ce2c0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:55.707780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3aab91ab-1368-45a2-aeb5-486ae74ce2c0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:55.708477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3aab91ab-1368-45a2-aeb5-486ae74ce2c0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:55.709830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3aab91ab-1368-45a2-aeb5-486ae74ce2c0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:55.710667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3aab91ab-1368-45a2-aeb5-486ae74ce2c0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:55.775643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-b283eda0-d023-422c-86d0-48784e0f0ea8 req-89f5f131-491f-4610-a69c-d7dcdff539d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d64168-bd90-4c29-bb47-7d69d4c12f4a", "tag": "b856b728-8b89-4bce-b61b-c056d80281f4"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:00:55.786710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-b283eda0-d023-422c-86d0-48784e0f0ea8 req-89f5f131-491f-4610-a69c-d7dcdff539d3 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:55.787233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-b283eda0-d023-422c-86d0-48784e0f0ea8 req-89f5f131-491f-4610-a69c-d7dcdff539d3 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:55.800234 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-b283eda0-d023-422c-86d0-48784e0f0ea8 req-89f5f131-491f-4610-a69c-d7dcdff539d3 service nova] Creating event network-changed:b856b728-8b89-4bce-b61b-c056d80281f4 for instance c3d64168-bd90-4c29-bb47-7d69d4c12f4a on hv-cinder-84301 May 24 13:00:55.806967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-b283eda0-d023-422c-86d0-48784e0f0ea8 req-89f5f131-491f-4610-a69c-d7dcdff539d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034891 May 24 13:00:55.807976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 74/141] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:00:55.898095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3aab91ab-1368-45a2-aeb5-486ae74ce2c0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:55.905874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3aab91ab-1368-45a2-aeb5-486ae74ce2c0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.218760 May 24 13:00:55.906477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 68/142] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:55 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:56.005352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:56.006237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:56.013250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:56.013773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:56.014644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:56.015165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:56.017710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5026f9df-f7bf-4168-97fa-15e743c02679 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:56.018510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5026f9df-f7bf-4168-97fa-15e743c02679 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:56.024637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5026f9df-f7bf-4168-97fa-15e743c02679 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:56.025101 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5026f9df-f7bf-4168-97fa-15e743c02679 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:56.025876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5026f9df-f7bf-4168-97fa-15e743c02679 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:56.026490 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5026f9df-f7bf-4168-97fa-15e743c02679 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:56.178794 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:56.181418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5026f9df-f7bf-4168-97fa-15e743c02679 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:56.187212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:56.188712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:56.189201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5026f9df-f7bf-4168-97fa-15e743c02679 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.175490 May 24 13:00:56.189857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 69/143] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:56 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:00:56.194474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-aa78069f-ab21-4e1e-80f8-fc7fdca82b1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.189293 May 24 13:00:56.194474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 75/144] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:55 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:00:56.697077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-90a8b00d-1954-417d-9482-dbb835d50145 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:56.697679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-90a8b00d-1954-417d-9482-dbb835d50145 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:56.703692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90a8b00d-1954-417d-9482-dbb835d50145 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:56.704129 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90a8b00d-1954-417d-9482-dbb835d50145 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:56.705146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90a8b00d-1954-417d-9482-dbb835d50145 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:56.705581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90a8b00d-1954-417d-9482-dbb835d50145 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:56.848174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-90a8b00d-1954-417d-9482-dbb835d50145 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:56.855988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-90a8b00d-1954-417d-9482-dbb835d50145 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1501 microversion: 2.1 time: 0.163200 May 24 13:00:56.856555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 76/145] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:56 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:56.922423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-20f8254f-2db2-4a0c-be99-c2b771295b88 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:56.923570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-20f8254f-2db2-4a0c-be99-c2b771295b88 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:56.929755 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20f8254f-2db2-4a0c-be99-c2b771295b88 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:56.930803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20f8254f-2db2-4a0c-be99-c2b771295b88 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:56.931575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20f8254f-2db2-4a0c-be99-c2b771295b88 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:56.932016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20f8254f-2db2-4a0c-be99-c2b771295b88 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:57.077491 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-20f8254f-2db2-4a0c-be99-c2b771295b88 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:57.085893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-20f8254f-2db2-4a0c-be99-c2b771295b88 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.167165 May 24 13:00:57.087258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 70/146] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:56 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:57.206207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-147f015f-bf61-4d76-a2db-510d69368009 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:57.206745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-147f015f-bf61-4d76-a2db-510d69368009 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:57.212327 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:57.213429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:57.213654 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-147f015f-bf61-4d76-a2db-510d69368009 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:57.214266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-147f015f-bf61-4d76-a2db-510d69368009 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:57.215402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-147f015f-bf61-4d76-a2db-510d69368009 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:57.216425 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-147f015f-bf61-4d76-a2db-510d69368009 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:57.221576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:57.222028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:57.223050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:57.223617 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:57.233682 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:57.379527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-147f015f-bf61-4d76-a2db-510d69368009 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:57.391075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:57.391869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-147f015f-bf61-4d76-a2db-510d69368009 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.189867 May 24 13:00:57.392781 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 77/147] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:57 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:57.399641 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:57.401332 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:57.402540 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-313658fd-6cfc-4daa-b15e-4ba1ee195c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.198342 May 24 13:00:57.403587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 71/148] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:57 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:00:58.102858 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-269e86ad-965b-4ba9-aa83-ceb01cd7a3e8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:58.103555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-269e86ad-965b-4ba9-aa83-ceb01cd7a3e8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:58.109669 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-269e86ad-965b-4ba9-aa83-ceb01cd7a3e8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:58.110217 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-269e86ad-965b-4ba9-aa83-ceb01cd7a3e8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:58.110899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-269e86ad-965b-4ba9-aa83-ceb01cd7a3e8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:58.111324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-269e86ad-965b-4ba9-aa83-ceb01cd7a3e8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:58.126700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:58.243018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-269e86ad-965b-4ba9-aa83-ceb01cd7a3e8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:58.251705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-269e86ad-965b-4ba9-aa83-ceb01cd7a3e8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.152509 May 24 13:00:58.252491 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 78/149] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:58 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:58.409462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-268bb206-9c42-4603-b2ef-e8d0d97a7d9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:58.410149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-268bb206-9c42-4603-b2ef-e8d0d97a7d9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:58.412068 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:58.421377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:58.422701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:58.426446 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-268bb206-9c42-4603-b2ef-e8d0d97a7d9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:58.426909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-268bb206-9c42-4603-b2ef-e8d0d97a7d9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:58.427870 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-268bb206-9c42-4603-b2ef-e8d0d97a7d9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:58.428518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-268bb206-9c42-4603-b2ef-e8d0d97a7d9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:58.432897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:58.433809 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:58.445297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:58.447555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:58.591009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-268bb206-9c42-4603-b2ef-e8d0d97a7d9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:58.599125 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-268bb206-9c42-4603-b2ef-e8d0d97a7d9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.193951 May 24 13:00:58.599702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 72/150] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:58 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:58.603098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:58.611226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:58.612717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:58.614025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fe91378a-e345-4798-ab18-9eb8310d594e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.197274 May 24 13:00:58.614610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 79/151] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:58 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:00:59.268797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ec877f8e-9ba2-4da6-b157-28ff5c720d91 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:59.269318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ec877f8e-9ba2-4da6-b157-28ff5c720d91 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:59.276994 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec877f8e-9ba2-4da6-b157-28ff5c720d91 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:59.277570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec877f8e-9ba2-4da6-b157-28ff5c720d91 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:59.278482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec877f8e-9ba2-4da6-b157-28ff5c720d91 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:59.279200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec877f8e-9ba2-4da6-b157-28ff5c720d91 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:59.408698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ec877f8e-9ba2-4da6-b157-28ff5c720d91 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:59.416685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ec877f8e-9ba2-4da6-b157-28ff5c720d91 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.151864 May 24 13:00:59.417237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 73/152] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:59 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:59.615831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d2458ee1-f456-44ed-8bcf-1ddda3648034 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:59.616449 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d2458ee1-f456-44ed-8bcf-1ddda3648034 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:59.623387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d2458ee1-f456-44ed-8bcf-1ddda3648034 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:59.623837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d2458ee1-f456-44ed-8bcf-1ddda3648034 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:59.624603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d2458ee1-f456-44ed-8bcf-1ddda3648034 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:59.625043 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d2458ee1-f456-44ed-8bcf-1ddda3648034 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:59.632030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:00:59.632821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:00:59.640449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:59.641021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:59.641850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:00:59.642486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:00:59.761831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d2458ee1-f456-44ed-8bcf-1ddda3648034 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:59.770745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d2458ee1-f456-44ed-8bcf-1ddda3648034 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.158514 May 24 13:00:59.774508 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 80/153] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:00:59 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:00:59.776782 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:59.784700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:59.786217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:00:59.787354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-98c3fcb5-3316-4f2a-91c3-6ef41fe34d23 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.159352 May 24 13:00:59.787905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 74/154] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:00:59 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:00.433365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7ed1a90b-f44b-4d7e-8d75-8d23f6fa2dc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:00.433979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7ed1a90b-f44b-4d7e-8d75-8d23f6fa2dc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:00.440296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a90b-f44b-4d7e-8d75-8d23f6fa2dc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:00.440746 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a90b-f44b-4d7e-8d75-8d23f6fa2dc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:00.441507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a90b-f44b-4d7e-8d75-8d23f6fa2dc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:00.441947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a90b-f44b-4d7e-8d75-8d23f6fa2dc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:00.567971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7ed1a90b-f44b-4d7e-8d75-8d23f6fa2dc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:00.576150 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7ed1a90b-f44b-4d7e-8d75-8d23f6fa2dc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.147144 May 24 13:01:00.576725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 81/155] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:00 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:00.790901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-082d927b-51d3-4118-a035-383dddc951bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:00.791476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-082d927b-51d3-4118-a035-383dddc951bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:00.797385 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-082d927b-51d3-4118-a035-383dddc951bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:00.797830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-082d927b-51d3-4118-a035-383dddc951bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:00.799810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-082d927b-51d3-4118-a035-383dddc951bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:00.799810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-082d927b-51d3-4118-a035-383dddc951bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:00.805743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:00.806405 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:00.813523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:00.813970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:00.814787 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:00.815335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:00.932724 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-082d927b-51d3-4118-a035-383dddc951bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:00.940063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-082d927b-51d3-4118-a035-383dddc951bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.153588 May 24 13:01:00.940803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 75/156] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:00 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:00.950941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:00.958728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:00.960224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:00.961369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9f047eaa-f794-44bd-8d60-88b2becce96b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.160176 May 24 13:01:00.961920 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 82/157] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:00 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:01.595601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9e44bac3-a45f-4f7a-9447-18583b071be2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:01.596544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9e44bac3-a45f-4f7a-9447-18583b071be2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:01.604739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e44bac3-a45f-4f7a-9447-18583b071be2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:01.605269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e44bac3-a45f-4f7a-9447-18583b071be2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:01.606023 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e44bac3-a45f-4f7a-9447-18583b071be2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:01.606570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e44bac3-a45f-4f7a-9447-18583b071be2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:01.749848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9e44bac3-a45f-4f7a-9447-18583b071be2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:01.757313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9e44bac3-a45f-4f7a-9447-18583b071be2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.167003 May 24 13:01:01.757929 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 76/158] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:01 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:01.959929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-04c923a0-a7b6-4430-b57d-097e190a7f68 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:01.960728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-04c923a0-a7b6-4430-b57d-097e190a7f68 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:01.967808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04c923a0-a7b6-4430-b57d-097e190a7f68 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:01.968435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04c923a0-a7b6-4430-b57d-097e190a7f68 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:01.969486 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04c923a0-a7b6-4430-b57d-097e190a7f68 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:01.969921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04c923a0-a7b6-4430-b57d-097e190a7f68 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:01.981700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:01.983162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:01.990990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:01.991741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:01.992865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:01.993594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:02.121377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-04c923a0-a7b6-4430-b57d-097e190a7f68 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:02.129146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-04c923a0-a7b6-4430-b57d-097e190a7f68 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.175140 May 24 13:01:02.130038 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 83/159] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:01 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:02.146609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:02.155047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:02.156476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:02.157565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-68a3bdb9-4797-4827-92c0-65da366dc421 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.181948 May 24 13:01:02.158114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 77/160] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:01 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:02.773551 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-56516e47-68ec-49e0-af47-60b05b20f91d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:02.774331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-56516e47-68ec-49e0-af47-60b05b20f91d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:02.780629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56516e47-68ec-49e0-af47-60b05b20f91d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:02.781068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56516e47-68ec-49e0-af47-60b05b20f91d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:02.782107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56516e47-68ec-49e0-af47-60b05b20f91d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:02.782731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56516e47-68ec-49e0-af47-60b05b20f91d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:03.143335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-56516e47-68ec-49e0-af47-60b05b20f91d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:03.150589 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aa3ced6b-4d99-4ac4-91d1-ce9274938a6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:03.151602 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aa3ced6b-4d99-4ac4-91d1-ce9274938a6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:03.155773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-56516e47-68ec-49e0-af47-60b05b20f91d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.386037 May 24 13:01:03.156547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 84/161] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:02 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:03.159017 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa3ced6b-4d99-4ac4-91d1-ce9274938a6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:03.159642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa3ced6b-4d99-4ac4-91d1-ce9274938a6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:03.160429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa3ced6b-4d99-4ac4-91d1-ce9274938a6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:03.160865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa3ced6b-4d99-4ac4-91d1-ce9274938a6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:03.178807 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:03.179689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:03.185784 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:03.186197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:03.187035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:03.187644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:03.304734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-aa3ced6b-4d99-4ac4-91d1-ce9274938a6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:03.312489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aa3ced6b-4d99-4ac4-91d1-ce9274938a6c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.168334 May 24 13:01:03.313145 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 78/162] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:03 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:03.331205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:03.339577 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:03.341082 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:03.342180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-24641b1d-628c-46f2-ba9c-338655f4843c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.168384 May 24 13:01:03.342844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 85/163] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:03 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:03.540438 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8ed971b3-0b22-4669-93e7-f7a5732e3680 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87b45b0e-afc1-45b5-8ece-eab950950856"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:03.541407 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8ed971b3-0b22-4669-93e7-f7a5732e3680 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:03.547450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ed971b3-0b22-4669-93e7-f7a5732e3680 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:03.547903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ed971b3-0b22-4669-93e7-f7a5732e3680 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:03.548661 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ed971b3-0b22-4669-93e7-f7a5732e3680 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:03.549097 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ed971b3-0b22-4669-93e7-f7a5732e3680 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:04.172113 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-748d8738-31f2-42dd-a29e-fafcbd31f5b2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:04.172732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-748d8738-31f2-42dd-a29e-fafcbd31f5b2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:04.183855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-748d8738-31f2-42dd-a29e-fafcbd31f5b2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:04.184509 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-748d8738-31f2-42dd-a29e-fafcbd31f5b2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:04.185665 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-748d8738-31f2-42dd-a29e-fafcbd31f5b2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:04.186171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-748d8738-31f2-42dd-a29e-fafcbd31f5b2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:04.354250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-748d8738-31f2-42dd-a29e-fafcbd31f5b2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:04.362930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-748d8738-31f2-42dd-a29e-fafcbd31f5b2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.194353 May 24 13:01:04.363702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 86/164] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:04 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:04.368913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7886b873-729a-40dd-ac11-0d7f232d517e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:04.369515 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7886b873-729a-40dd-ac11-0d7f232d517e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:04.375912 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7886b873-729a-40dd-ac11-0d7f232d517e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:04.376251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7886b873-729a-40dd-ac11-0d7f232d517e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:04.377009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7886b873-729a-40dd-ac11-0d7f232d517e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:04.377437 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7886b873-729a-40dd-ac11-0d7f232d517e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:04.538583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7886b873-729a-40dd-ac11-0d7f232d517e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:04.546842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7886b873-729a-40dd-ac11-0d7f232d517e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.181953 May 24 13:01:04.547513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 87/165] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:04 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:04.551927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:04.552534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:04.558213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:04.558706 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:04.562841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:04.563386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:04.692035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:04.701162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:04.702803 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:04.704194 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cceaed9e-4e3b-4757-a5a7-56e9ba70e587 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.155759 May 24 13:01:04.704754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 88/166] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:04 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:05.379716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a6600799-0ea2-4cbb-bff2-6060748e328b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:05.380329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a6600799-0ea2-4cbb-bff2-6060748e328b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:05.386418 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6600799-0ea2-4cbb-bff2-6060748e328b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:05.386870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6600799-0ea2-4cbb-bff2-6060748e328b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:05.387628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6600799-0ea2-4cbb-bff2-6060748e328b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:05.388061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6600799-0ea2-4cbb-bff2-6060748e328b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:05.518761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a6600799-0ea2-4cbb-bff2-6060748e328b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:05.526686 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a6600799-0ea2-4cbb-bff2-6060748e328b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.150672 May 24 13:01:05.527260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 89/167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:05 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:05.563328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a53de080-17f3-4ec2-8391-ecaf241d1ee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:05.563926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a53de080-17f3-4ec2-8391-ecaf241d1ee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:05.569673 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a53de080-17f3-4ec2-8391-ecaf241d1ee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:05.570120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a53de080-17f3-4ec2-8391-ecaf241d1ee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:05.571388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a53de080-17f3-4ec2-8391-ecaf241d1ee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:05.571815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a53de080-17f3-4ec2-8391-ecaf241d1ee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:05.698461 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a53de080-17f3-4ec2-8391-ecaf241d1ee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:05.705768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a53de080-17f3-4ec2-8391-ecaf241d1ee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.146125 May 24 13:01:05.706343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 90/168] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:05 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:05.722762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:05.723366 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:05.729032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:05.729473 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:05.730222 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:05.730679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:05.860639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:05.869073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:05.870599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:05.871691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ebf3335a-7548-4e1e-84d4-f1b2befd2dea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.152475 May 24 13:01:05.872497 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 91/169] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:05 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:06.542799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bd70a1e3-5018-42ec-b8b4-c06583d91aed tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:06.543456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bd70a1e3-5018-42ec-b8b4-c06583d91aed tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:06.549537 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd70a1e3-5018-42ec-b8b4-c06583d91aed tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:06.549977 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd70a1e3-5018-42ec-b8b4-c06583d91aed tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:06.550760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd70a1e3-5018-42ec-b8b4-c06583d91aed tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:06.551190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd70a1e3-5018-42ec-b8b4-c06583d91aed tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:06.871177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8ed971b3-0b22-4669-93e7-f7a5732e3680 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "POST /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.335189 May 24 13:01:06.873172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 79/170] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 13:01:03 2022] POST /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3/os-volume_attachments => generated 194 bytes in 3338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:01:06.901095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef56fd95-15fe-416a-a533-5644c34f3b53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:06.901095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ef56fd95-15fe-416a-a533-5644c34f3b53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:06.905680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef56fd95-15fe-416a-a533-5644c34f3b53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:06.906128 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef56fd95-15fe-416a-a533-5644c34f3b53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:06.907715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef56fd95-15fe-416a-a533-5644c34f3b53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:06.908501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef56fd95-15fe-416a-a533-5644c34f3b53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:07.125008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ef56fd95-15fe-416a-a533-5644c34f3b53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:07.132409 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ef56fd95-15fe-416a-a533-5644c34f3b53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.258093 May 24 13:01:07.133038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 80/171] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:06 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:07.137531 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:07.138138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:07.144574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:07.145275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:07.146183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:07.146712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:07.168045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bd70a1e3-5018-42ec-b8b4-c06583d91aed tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:07.175680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bd70a1e3-5018-42ec-b8b4-c06583d91aed tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.636658 May 24 13:01:07.176294 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 92/172] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:06 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:07.277140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:07.285070 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:07.286623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:07.287718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-58e3db74-2ee8-4d33-bbd6-c34e3b37aa74 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.153780 May 24 13:01:07.288266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 81/173] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:07 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:08.151335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ae7084c5-7913-4b33-86fb-c638429f9916 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:08.151951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ae7084c5-7913-4b33-86fb-c638429f9916 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:08.158143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae7084c5-7913-4b33-86fb-c638429f9916 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:08.158675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae7084c5-7913-4b33-86fb-c638429f9916 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:08.159463 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae7084c5-7913-4b33-86fb-c638429f9916 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:08.159931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae7084c5-7913-4b33-86fb-c638429f9916 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:08.192604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-279e9ca8-a4e7-415e-857b-838e04a2cac6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:08.193219 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-279e9ca8-a4e7-415e-857b-838e04a2cac6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:08.200339 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279e9ca8-a4e7-415e-857b-838e04a2cac6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:08.200787 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279e9ca8-a4e7-415e-857b-838e04a2cac6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:08.201555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279e9ca8-a4e7-415e-857b-838e04a2cac6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:08.201987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279e9ca8-a4e7-415e-857b-838e04a2cac6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:08.296730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ae7084c5-7913-4b33-86fb-c638429f9916 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:08.306754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ae7084c5-7913-4b33-86fb-c638429f9916 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.159843 May 24 13:01:08.307476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 93/174] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:08 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:08.312203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:08.313004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:08.318992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:08.319526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:08.320639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:08.320994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:08.337862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-279e9ca8-a4e7-415e-857b-838e04a2cac6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:08.347375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-279e9ca8-a4e7-415e-857b-838e04a2cac6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.158634 May 24 13:01:08.350410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 82/175] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:08 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:08.458162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:08.466578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:08.468168 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:08.469395 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9763bda4-e8fd-4ea0-8030-b20b5d88764a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.160725 May 24 13:01:08.469959 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 94/176] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:08 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:09.324114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e0b7f4e3-b218-4d6a-bc9f-fb1cf999b8ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:09.324719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e0b7f4e3-b218-4d6a-bc9f-fb1cf999b8ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:09.331295 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f4e3-b218-4d6a-bc9f-fb1cf999b8ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:09.331735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f4e3-b218-4d6a-bc9f-fb1cf999b8ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:09.332489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f4e3-b218-4d6a-bc9f-fb1cf999b8ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:09.332917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f4e3-b218-4d6a-bc9f-fb1cf999b8ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:09.364318 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e109574b-354f-4270-8428-7af3a547dc47 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:09.365054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e109574b-354f-4270-8428-7af3a547dc47 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:09.371259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e109574b-354f-4270-8428-7af3a547dc47 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:09.372097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e109574b-354f-4270-8428-7af3a547dc47 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:09.372932 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e109574b-354f-4270-8428-7af3a547dc47 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:09.373465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e109574b-354f-4270-8428-7af3a547dc47 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:09.377811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:09.461474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e0b7f4e3-b218-4d6a-bc9f-fb1cf999b8ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:09.469037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e0b7f4e3-b218-4d6a-bc9f-fb1cf999b8ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.149215 May 24 13:01:09.469604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 83/177] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:09 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:09.487851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:09.488465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:09.494986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:09.495430 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:09.496197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:09.496874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:09.505812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e109574b-354f-4270-8428-7af3a547dc47 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:09.513953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e109574b-354f-4270-8428-7af3a547dc47 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.153442 May 24 13:01:09.514549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 95/178] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:09 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:09.633795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:09.642572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:09.644069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:09.645159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-280f7b1a-69c2-4067-84b2-324a0cca2bf5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.161194 May 24 13:01:09.645707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 84/179] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:09 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:10.485677 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d736ded6-f47c-4d1f-b200-acbbe6cd317d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:10.486324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d736ded6-f47c-4d1f-b200-acbbe6cd317d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:10.492935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d736ded6-f47c-4d1f-b200-acbbe6cd317d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:10.493376 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d736ded6-f47c-4d1f-b200-acbbe6cd317d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:10.494121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d736ded6-f47c-4d1f-b200-acbbe6cd317d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:10.494583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d736ded6-f47c-4d1f-b200-acbbe6cd317d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:10.530657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4e72e88c-bf6d-4873-8ca5-130a2f9353d5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:10.531385 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4e72e88c-bf6d-4873-8ca5-130a2f9353d5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:10.537954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e72e88c-bf6d-4873-8ca5-130a2f9353d5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:10.538448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e72e88c-bf6d-4873-8ca5-130a2f9353d5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:10.539724 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e72e88c-bf6d-4873-8ca5-130a2f9353d5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:10.540169 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e72e88c-bf6d-4873-8ca5-130a2f9353d5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:10.627810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d736ded6-f47c-4d1f-b200-acbbe6cd317d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:10.635627 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d736ded6-f47c-4d1f-b200-acbbe6cd317d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.153730 May 24 13:01:10.636392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 96/180] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:10 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:10.663075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:10.664823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:10.670777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4e72e88c-bf6d-4873-8ca5-130a2f9353d5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:10.670943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:10.671257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:10.672068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:10.672489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:10.680218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4e72e88c-bf6d-4873-8ca5-130a2f9353d5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.152838 May 24 13:01:10.680799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 85/181] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:10 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:10.797703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:10.806183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:10.807749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:10.808845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6896de8a-0ef4-4dfe-933d-50fb6270d548 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.149707 May 24 13:01:10.809405 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 97/182] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:10 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:11.653010 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dd3b861a-800e-42d3-a4a8-0d60f221e5e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:11.653616 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dd3b861a-800e-42d3-a4a8-0d60f221e5e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:11.660146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd3b861a-800e-42d3-a4a8-0d60f221e5e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:11.660594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd3b861a-800e-42d3-a4a8-0d60f221e5e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:11.661349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd3b861a-800e-42d3-a4a8-0d60f221e5e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:11.661782 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd3b861a-800e-42d3-a4a8-0d60f221e5e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:11.676371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:11.697487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-85d2baa7-9bc3-42b0-bfed-12cf7c1a54bf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:11.698139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-85d2baa7-9bc3-42b0-bfed-12cf7c1a54bf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:11.704308 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-85d2baa7-9bc3-42b0-bfed-12cf7c1a54bf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:11.704757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-85d2baa7-9bc3-42b0-bfed-12cf7c1a54bf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:11.705529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-85d2baa7-9bc3-42b0-bfed-12cf7c1a54bf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:11.705968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-85d2baa7-9bc3-42b0-bfed-12cf7c1a54bf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:11.795643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dd3b861a-800e-42d3-a4a8-0d60f221e5e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:11.803079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dd3b861a-800e-42d3-a4a8-0d60f221e5e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.154383 May 24 13:01:11.803667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 86/183] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:11 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:11.826879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:11.827480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:11.833349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:11.833804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:11.834558 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:11.834986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:11.842241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-85d2baa7-9bc3-42b0-bfed-12cf7c1a54bf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:11.849520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-85d2baa7-9bc3-42b0-bfed-12cf7c1a54bf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.156674 May 24 13:01:11.850090 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 98/184] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:11 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:11.966020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:11.973867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:11.975405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:11.976528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-63ce8bb4-ce0f-42e1-b63d-cae776b3cf30 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.153390 May 24 13:01:11.977074 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 87/185] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:11 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:12.661722 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-c2cb6d99-f296-45ca-b33a-a2e3e1b23b47 req-34dee7e0-c0ff-46dd-b30d-c2dff1ed7a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6db3c9-4cac-4157-ba43-3c425854302d", "name": "network-vif-plugged", "status": "completed", "tag": "59643b71-d317-4922-9d19-0298524e0346"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:12.679177 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-c2cb6d99-f296-45ca-b33a-a2e3e1b23b47 req-34dee7e0-c0ff-46dd-b30d-c2dff1ed7a05 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:12.679177 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-c2cb6d99-f296-45ca-b33a-a2e3e1b23b47 req-34dee7e0-c0ff-46dd-b30d-c2dff1ed7a05 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:12.690970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-c2cb6d99-f296-45ca-b33a-a2e3e1b23b47 req-34dee7e0-c0ff-46dd-b30d-c2dff1ed7a05 service nova] Creating event network-vif-plugged:59643b71-d317-4922-9d19-0298524e0346 for instance dc6db3c9-4cac-4157-ba43-3c425854302d on hv-cinder-84301 May 24 13:01:12.699863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-c2cb6d99-f296-45ca-b33a-a2e3e1b23b47 req-34dee7e0-c0ff-46dd-b30d-c2dff1ed7a05 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038512 May 24 13:01:12.699863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 99/186] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:01:12.821792 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-49e039e3-13c1-4ff6-b69f-06d80fecf812 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:12.822895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-49e039e3-13c1-4ff6-b69f-06d80fecf812 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:12.829359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-49e039e3-13c1-4ff6-b69f-06d80fecf812 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:12.829810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-49e039e3-13c1-4ff6-b69f-06d80fecf812 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:12.830605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-49e039e3-13c1-4ff6-b69f-06d80fecf812 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:12.831045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-49e039e3-13c1-4ff6-b69f-06d80fecf812 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:12.870088 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-551ad3a1-f58c-4de0-8f95-ad07b8ef254a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:12.870988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-551ad3a1-f58c-4de0-8f95-ad07b8ef254a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:12.882183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-551ad3a1-f58c-4de0-8f95-ad07b8ef254a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:12.883301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-551ad3a1-f58c-4de0-8f95-ad07b8ef254a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:12.884109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-551ad3a1-f58c-4de0-8f95-ad07b8ef254a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:12.884541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-551ad3a1-f58c-4de0-8f95-ad07b8ef254a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:12.958904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-49e039e3-13c1-4ff6-b69f-06d80fecf812 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:12.967795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-49e039e3-13c1-4ff6-b69f-06d80fecf812 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.151588 May 24 13:01:12.968367 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 88/187] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:12 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:12.994362 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:12.994970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:13.001283 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:13.001736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:13.002532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:13.002968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:13.012898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-551ad3a1-f58c-4de0-8f95-ad07b8ef254a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:13.020401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-551ad3a1-f58c-4de0-8f95-ad07b8ef254a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.156544 May 24 13:01:13.021011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 100/188] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:12 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:13.129019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:13.137480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:13.139018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:13.140106 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-81fbfcea-dfd3-42b3-8d88-2b54585d73d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.149675 May 24 13:01:13.140664 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 89/189] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:12 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:13.984719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c805a257-b6ed-4ad4-a326-03d4398fdc25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:13.985291 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c805a257-b6ed-4ad4-a326-03d4398fdc25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:13.991390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c805a257-b6ed-4ad4-a326-03d4398fdc25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:13.991834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c805a257-b6ed-4ad4-a326-03d4398fdc25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:13.992587 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c805a257-b6ed-4ad4-a326-03d4398fdc25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:13.993018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c805a257-b6ed-4ad4-a326-03d4398fdc25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:14.037236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-67932a80-2b63-4825-8115-a51d438b931f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:14.037881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-67932a80-2b63-4825-8115-a51d438b931f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:14.045559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67932a80-2b63-4825-8115-a51d438b931f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:14.046008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67932a80-2b63-4825-8115-a51d438b931f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:14.046822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67932a80-2b63-4825-8115-a51d438b931f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:14.047258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67932a80-2b63-4825-8115-a51d438b931f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:14.184761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67932a80-2b63-4825-8115-a51d438b931f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:14.192609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-67932a80-2b63-4825-8115-a51d438b931f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.159298 May 24 13:01:14.193184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 90/190] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:14 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:14.197871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:14.198521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:14.204384 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:14.204833 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:14.205594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:14.206026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:14.270603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c805a257-b6ed-4ad4-a326-03d4398fdc25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:14.278875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c805a257-b6ed-4ad4-a326-03d4398fdc25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.298103 May 24 13:01:14.279453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 101/191] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:13 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:14.333157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:14.342023 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:14.343553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:14.344680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7017f6cd-7aff-4ccc-aace-731854c4ac22 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.150561 May 24 13:01:14.345241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 91/192] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:14 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:15.209207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-149dfccc-b595-4ba3-9531-70fa977b41b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:15.209867 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-149dfccc-b595-4ba3-9531-70fa977b41b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:15.216075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-149dfccc-b595-4ba3-9531-70fa977b41b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:15.216523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-149dfccc-b595-4ba3-9531-70fa977b41b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:15.217285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-149dfccc-b595-4ba3-9531-70fa977b41b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:15.217720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-149dfccc-b595-4ba3-9531-70fa977b41b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:15.296157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4365c82f-7e68-4ac4-9403-368ccda99dc5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:15.296522 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4365c82f-7e68-4ac4-9403-368ccda99dc5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:15.303001 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4365c82f-7e68-4ac4-9403-368ccda99dc5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:15.303454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4365c82f-7e68-4ac4-9403-368ccda99dc5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:15.304264 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4365c82f-7e68-4ac4-9403-368ccda99dc5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:15.305313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4365c82f-7e68-4ac4-9403-368ccda99dc5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:15.348295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-149dfccc-b595-4ba3-9531-70fa977b41b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:15.356095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-149dfccc-b595-4ba3-9531-70fa977b41b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.150956 May 24 13:01:15.362414 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 102/193] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:15 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:15.368285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:15.369175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:15.375815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:15.376327 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:15.377185 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:15.377613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:15.441460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4365c82f-7e68-4ac4-9403-368ccda99dc5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:15.449103 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4365c82f-7e68-4ac4-9403-368ccda99dc5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.157092 May 24 13:01:15.449891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 92/194] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:15 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:15.516420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:15.524899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:15.526445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:15.527543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d5a61c80-706f-456b-87b2-d93885aeb2c9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.163925 May 24 13:01:15.528094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 103/195] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:15 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:16.373180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9ce4f518-5cec-4fa8-8b2d-cac5f9f14f6a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:16.373790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9ce4f518-5cec-4fa8-8b2d-cac5f9f14f6a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:16.380426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ce4f518-5cec-4fa8-8b2d-cac5f9f14f6a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:16.380877 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ce4f518-5cec-4fa8-8b2d-cac5f9f14f6a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:16.381636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ce4f518-5cec-4fa8-8b2d-cac5f9f14f6a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:16.382081 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ce4f518-5cec-4fa8-8b2d-cac5f9f14f6a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:16.464859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ec5010a5-493e-4614-8590-ea0cc1bf4f87 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:16.466249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ec5010a5-493e-4614-8590-ea0cc1bf4f87 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:16.472341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec5010a5-493e-4614-8590-ea0cc1bf4f87 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:16.472785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec5010a5-493e-4614-8590-ea0cc1bf4f87 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:16.473538 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec5010a5-493e-4614-8590-ea0cc1bf4f87 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:16.473962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec5010a5-493e-4614-8590-ea0cc1bf4f87 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:16.517590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9ce4f518-5cec-4fa8-8b2d-cac5f9f14f6a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:16.527141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9ce4f518-5cec-4fa8-8b2d-cac5f9f14f6a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.158102 May 24 13:01:16.527896 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 93/196] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:16 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:16.545212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:16.545901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:16.551994 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:16.552538 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:16.553387 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:16.553882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:16.610305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ec5010a5-493e-4614-8590-ea0cc1bf4f87 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:16.619469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ec5010a5-493e-4614-8590-ea0cc1bf4f87 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.157923 May 24 13:01:16.619811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 104/197] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:16 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:16.683477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:16.691523 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:16.693071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:16.694188 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d1b4c1a5-bd2d-4a39-ba09-6f5b95f31205 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.152808 May 24 13:01:16.694790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 94/198] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:16 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:17.542890 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-64734c79-2ccc-4eb9-bb9b-1f78ce355343 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:17.543502 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-64734c79-2ccc-4eb9-bb9b-1f78ce355343 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:17.550110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64734c79-2ccc-4eb9-bb9b-1f78ce355343 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:17.550587 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64734c79-2ccc-4eb9-bb9b-1f78ce355343 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:17.551364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64734c79-2ccc-4eb9-bb9b-1f78ce355343 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:17.551775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64734c79-2ccc-4eb9-bb9b-1f78ce355343 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:17.636526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5d9aba0c-e8b2-46f7-82ed-d5183b99eb92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:17.637144 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5d9aba0c-e8b2-46f7-82ed-d5183b99eb92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:17.643663 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d9aba0c-e8b2-46f7-82ed-d5183b99eb92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:17.644110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d9aba0c-e8b2-46f7-82ed-d5183b99eb92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:17.644871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d9aba0c-e8b2-46f7-82ed-d5183b99eb92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:17.645314 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d9aba0c-e8b2-46f7-82ed-d5183b99eb92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:17.681089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-64734c79-2ccc-4eb9-bb9b-1f78ce355343 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:17.688513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-64734c79-2ccc-4eb9-bb9b-1f78ce355343 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.149320 May 24 13:01:17.689085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 105/199] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:17 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:17.711922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:17.712527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:17.718507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:17.718947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:17.719699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:17.720124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:17.778675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5d9aba0c-e8b2-46f7-82ed-d5183b99eb92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:17.786659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5d9aba0c-e8b2-46f7-82ed-d5183b99eb92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.154353 May 24 13:01:17.787322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 95/200] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:17 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:17.859451 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:17.870170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:17.871967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:17.873232 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d6b1a671-a3b8-4ee4-8ebe-333a5fa810b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.165134 May 24 13:01:17.873834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 106/201] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:17 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:18.704927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ac7a4995-4d3e-479a-9276-5502811b0b82 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:18.705544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ac7a4995-4d3e-479a-9276-5502811b0b82 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:18.709174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=82 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:18.713429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac7a4995-4d3e-479a-9276-5502811b0b82 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:18.713884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac7a4995-4d3e-479a-9276-5502811b0b82 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:18.714703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac7a4995-4d3e-479a-9276-5502811b0b82 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:18.715137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac7a4995-4d3e-479a-9276-5502811b0b82 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:18.806432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-66f644e4-0aaf-44f8-8a79-ec4cca96eb12 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:18.807300 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-66f644e4-0aaf-44f8-8a79-ec4cca96eb12 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:18.819286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66f644e4-0aaf-44f8-8a79-ec4cca96eb12 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:18.820480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66f644e4-0aaf-44f8-8a79-ec4cca96eb12 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:18.822021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66f644e4-0aaf-44f8-8a79-ec4cca96eb12 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:18.822639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66f644e4-0aaf-44f8-8a79-ec4cca96eb12 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:18.883947 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ac7a4995-4d3e-479a-9276-5502811b0b82 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:18.894035 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ac7a4995-4d3e-479a-9276-5502811b0b82 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.192724 May 24 13:01:18.894798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 96/202] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:18 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:18.900438 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:18.901114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:18.908122 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:18.908850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:18.909978 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:18.910777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:19.009544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-66f644e4-0aaf-44f8-8a79-ec4cca96eb12 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:19.017229 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-66f644e4-0aaf-44f8-8a79-ec4cca96eb12 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.216385 May 24 13:01:19.017896 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 107/203] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:18 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:19.047562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:19.055701 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:19.057254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:19.058397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5fb666bb-ef59-49cd-9dfe-02f1b352a938 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.162299 May 24 13:01:19.059122 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 97/204] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:18 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:19.911465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2959a80e-36bd-423e-a023-582989633e07 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:19.912081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2959a80e-36bd-423e-a023-582989633e07 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:19.918909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2959a80e-36bd-423e-a023-582989633e07 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:19.919407 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2959a80e-36bd-423e-a023-582989633e07 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:19.920196 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2959a80e-36bd-423e-a023-582989633e07 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:19.920662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2959a80e-36bd-423e-a023-582989633e07 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:20.035034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-83dc24b2-5311-4c6b-b5f4-8a349ff64aa1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:20.035709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-83dc24b2-5311-4c6b-b5f4-8a349ff64aa1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:20.044168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83dc24b2-5311-4c6b-b5f4-8a349ff64aa1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:20.044690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83dc24b2-5311-4c6b-b5f4-8a349ff64aa1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:20.045568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83dc24b2-5311-4c6b-b5f4-8a349ff64aa1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:20.046031 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83dc24b2-5311-4c6b-b5f4-8a349ff64aa1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:20.099482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2959a80e-36bd-423e-a023-582989633e07 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:20.117929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2959a80e-36bd-423e-a023-582989633e07 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.210248 May 24 13:01:20.128933 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 108/205] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:19 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:20.134804 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:20.135425 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:20.141802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:20.142260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:20.143077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:20.143513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:20.191358 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-83dc24b2-5311-4c6b-b5f4-8a349ff64aa1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:20.200369 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-83dc24b2-5311-4c6b-b5f4-8a349ff64aa1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.169022 May 24 13:01:20.209691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 98/206] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:20 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:20.282823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:20.291216 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:20.292955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:20.294052 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5f43acfa-bc48-429b-add9-63f76fd2ec3b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.163949 May 24 13:01:20.294635 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 109/207] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:20 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:21.135236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3dff449d-ac61-48b3-9367-c37c9546d7b0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:21.135885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3dff449d-ac61-48b3-9367-c37c9546d7b0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:21.142267 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dff449d-ac61-48b3-9367-c37c9546d7b0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:21.142750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dff449d-ac61-48b3-9367-c37c9546d7b0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:21.143514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dff449d-ac61-48b3-9367-c37c9546d7b0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:21.143957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dff449d-ac61-48b3-9367-c37c9546d7b0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:21.218204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-90036317-3c4b-42a4-b727-76e6416aac99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:21.218912 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-90036317-3c4b-42a4-b727-76e6416aac99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:21.225719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90036317-3c4b-42a4-b727-76e6416aac99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:21.226212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90036317-3c4b-42a4-b727-76e6416aac99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:21.227009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90036317-3c4b-42a4-b727-76e6416aac99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:21.227439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90036317-3c4b-42a4-b727-76e6416aac99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:21.278317 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3dff449d-ac61-48b3-9367-c37c9546d7b0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:21.286048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3dff449d-ac61-48b3-9367-c37c9546d7b0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.155131 May 24 13:01:21.286879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 99/208] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:21 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:21.311112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:21.311728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:21.318548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:21.318998 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:21.320372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:21.320867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:21.370363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-90036317-3c4b-42a4-b727-76e6416aac99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:21.378228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-90036317-3c4b-42a4-b727-76e6416aac99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.164659 May 24 13:01:21.379075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 110/209] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:21 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:21.477047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:21.488288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:21.489963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:21.491778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0cb30381-e709-4974-a482-b3875e2bc39e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.184458 May 24 13:01:21.492539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 100/210] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:21 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:22.302531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c401df07-b135-4ae6-9e1b-f6be3b6d7914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:22.303149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c401df07-b135-4ae6-9e1b-f6be3b6d7914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:22.309110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c401df07-b135-4ae6-9e1b-f6be3b6d7914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:22.309577 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c401df07-b135-4ae6-9e1b-f6be3b6d7914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:22.310345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c401df07-b135-4ae6-9e1b-f6be3b6d7914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:22.310786 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c401df07-b135-4ae6-9e1b-f6be3b6d7914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:22.395128 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a4e22b04-dc94-4814-ae76-fc71793e236d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:22.395743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a4e22b04-dc94-4814-ae76-fc71793e236d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:22.403059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4e22b04-dc94-4814-ae76-fc71793e236d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:22.403505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4e22b04-dc94-4814-ae76-fc71793e236d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:22.404267 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4e22b04-dc94-4814-ae76-fc71793e236d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:22.404750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4e22b04-dc94-4814-ae76-fc71793e236d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:22.494503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c401df07-b135-4ae6-9e1b-f6be3b6d7914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:22.511280 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c401df07-b135-4ae6-9e1b-f6be3b6d7914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.212145 May 24 13:01:22.512504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 111/211] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:22 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:22.519445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:22.521418 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:22.530397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:22.531099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:22.532187 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:22.532832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:22.549591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:22.568254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a4e22b04-dc94-4814-ae76-fc71793e236d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:22.576946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a4e22b04-dc94-4814-ae76-fc71793e236d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.185625 May 24 13:01:22.577665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 101/212] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:22 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:22.733753 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:22.750718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:22.752421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:22.753668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8b7e15ec-8f19-4134-acf2-0cbb91b2ddb3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.239695 May 24 13:01:22.754329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 112/213] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:22 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:23.528355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-606ddda0-c6c1-4594-a788-6f7b7d21249b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:23.528970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-606ddda0-c6c1-4594-a788-6f7b7d21249b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:23.535380 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-606ddda0-c6c1-4594-a788-6f7b7d21249b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:23.535830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-606ddda0-c6c1-4594-a788-6f7b7d21249b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:23.536595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-606ddda0-c6c1-4594-a788-6f7b7d21249b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:23.537030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-606ddda0-c6c1-4594-a788-6f7b7d21249b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:23.596071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f6e9d93b-d598-450c-8f6a-ee961d84268f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:23.598024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f6e9d93b-d598-450c-8f6a-ee961d84268f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:23.605223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f6e9d93b-d598-450c-8f6a-ee961d84268f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:23.606231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f6e9d93b-d598-450c-8f6a-ee961d84268f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:23.607239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f6e9d93b-d598-450c-8f6a-ee961d84268f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:23.607953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f6e9d93b-d598-450c-8f6a-ee961d84268f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:23.697451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-606ddda0-c6c1-4594-a788-6f7b7d21249b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:23.705686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-606ddda0-c6c1-4594-a788-6f7b7d21249b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.180902 May 24 13:01:23.706386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 102/214] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:23 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:23.762947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f6e9d93b-d598-450c-8f6a-ee961d84268f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:23.773592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f6e9d93b-d598-450c-8f6a-ee961d84268f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.182848 May 24 13:01:23.773723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:23.774433 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:23.783723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:23.784009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 113/215] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:23 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:23.784574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:23.785919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:23.786387 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:23.801685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:23.949279 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:23.961880 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:23.964545 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:23.966089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b184a20b-8e66-4c21-a2c5-feafd3350a38 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.197269 May 24 13:01:23.966765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 103/216] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:23 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:24.722486 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-353ef22f-8aa0-4525-a047-31d3a7ffe521 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:24.723707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-353ef22f-8aa0-4525-a047-31d3a7ffe521 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:24.731225 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-353ef22f-8aa0-4525-a047-31d3a7ffe521 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:24.731969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-353ef22f-8aa0-4525-a047-31d3a7ffe521 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:24.733191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-353ef22f-8aa0-4525-a047-31d3a7ffe521 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:24.733726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-353ef22f-8aa0-4525-a047-31d3a7ffe521 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:24.791560 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-494863f3-4804-4b7d-95da-d7b04d79629b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:24.792185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-494863f3-4804-4b7d-95da-d7b04d79629b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:24.801012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494863f3-4804-4b7d-95da-d7b04d79629b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:24.801456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494863f3-4804-4b7d-95da-d7b04d79629b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:24.802224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494863f3-4804-4b7d-95da-d7b04d79629b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:24.802692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494863f3-4804-4b7d-95da-d7b04d79629b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:24.923738 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-353ef22f-8aa0-4525-a047-31d3a7ffe521 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:24.933329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-353ef22f-8aa0-4525-a047-31d3a7ffe521 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.213634 May 24 13:01:24.934396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 114/217] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:24 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:24.974830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-494863f3-4804-4b7d-95da-d7b04d79629b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:24.985267 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-494863f3-4804-4b7d-95da-d7b04d79629b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.197351 May 24 13:01:24.985652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:24.994678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:24.995635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 104/218] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:24 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:24.995739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:24.995739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:24.995739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:24.995739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:25.131416 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:25.140491 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:25.142000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:25.143124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d94d3d3c-4b18-478d-9b75-28d5d0fdca7a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.161581 May 24 13:01:25.143679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 115/219] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:24 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:25.955748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2e621ec5-456e-4f1d-b5e5-2b7d5290db6c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:25.956421 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2e621ec5-456e-4f1d-b5e5-2b7d5290db6c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:25.973608 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e621ec5-456e-4f1d-b5e5-2b7d5290db6c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:25.975245 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e621ec5-456e-4f1d-b5e5-2b7d5290db6c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:25.979640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e621ec5-456e-4f1d-b5e5-2b7d5290db6c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:25.983665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e621ec5-456e-4f1d-b5e5-2b7d5290db6c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:26.003693 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c183ed6e-153d-435d-a059-e29385188e3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:26.004247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c183ed6e-153d-435d-a059-e29385188e3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:26.006524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=86 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:26.014835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c183ed6e-153d-435d-a059-e29385188e3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:26.015263 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c183ed6e-153d-435d-a059-e29385188e3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:26.021676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c183ed6e-153d-435d-a059-e29385188e3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:26.022336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c183ed6e-153d-435d-a059-e29385188e3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:26.362967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2e621ec5-456e-4f1d-b5e5-2b7d5290db6c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:26.373274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2e621ec5-456e-4f1d-b5e5-2b7d5290db6c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.422011 May 24 13:01:26.374055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 105/220] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:25 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:26.398750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:26.412317 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:26.429713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:26.430370 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:26.434518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:26.439863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:26.578860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c183ed6e-153d-435d-a059-e29385188e3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:26.593133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c183ed6e-153d-435d-a059-e29385188e3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.593146 May 24 13:01:26.595521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 116/221] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:25 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:26.665310 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-e08dd2fb-ad27-4d1d-9890-d01ffa0c38dc req-895961b8-09f7-472e-a809-08cd54547c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dbd25ed-5661-4c08-949c-27204c6c1172", "name": "network-vif-plugged", "status": "completed", "tag": "d4232814-2adb-4fc6-bd44-4cb7c7da4de1"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:26.686603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-e08dd2fb-ad27-4d1d-9890-d01ffa0c38dc req-895961b8-09f7-472e-a809-08cd54547c7b service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:26.687469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-e08dd2fb-ad27-4d1d-9890-d01ffa0c38dc req-895961b8-09f7-472e-a809-08cd54547c7b service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:26.713120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-e08dd2fb-ad27-4d1d-9890-d01ffa0c38dc req-895961b8-09f7-472e-a809-08cd54547c7b service nova] Creating event network-vif-plugged:d4232814-2adb-4fc6-bd44-4cb7c7da4de1 for instance 8dbd25ed-5661-4c08-949c-27204c6c1172 on hv-cinder-84301 May 24 13:01:26.720088 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-e08dd2fb-ad27-4d1d-9890-d01ffa0c38dc req-895961b8-09f7-472e-a809-08cd54547c7b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059385 May 24 13:01:26.720692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 117/222] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:01:26.807673 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:26.838345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:26.840134 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:26.841344 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-047c4e91-7b1d-458d-b61b-af2bf3a94561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.466324 May 24 13:01:26.841993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 106/223] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:26 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:27.391914 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-40c4eb1c-cb0d-4387-b1a2-20073cc8c701 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:27.392609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-40c4eb1c-cb0d-4387-b1a2-20073cc8c701 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:27.402593 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-40c4eb1c-cb0d-4387-b1a2-20073cc8c701 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:27.402842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-40c4eb1c-cb0d-4387-b1a2-20073cc8c701 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:27.410369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-40c4eb1c-cb0d-4387-b1a2-20073cc8c701 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:27.411030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-40c4eb1c-cb0d-4387-b1a2-20073cc8c701 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:27.577964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-40c4eb1c-cb0d-4387-b1a2-20073cc8c701 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:27.586514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-40c4eb1c-cb0d-4387-b1a2-20073cc8c701 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.199415 May 24 13:01:27.587108 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 118/224] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:27 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:27.613671 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e0311ae6-af7a-4bcc-8202-2b537791f622 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:27.614318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e0311ae6-af7a-4bcc-8202-2b537791f622 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:27.620999 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0311ae6-af7a-4bcc-8202-2b537791f622 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:27.621709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0311ae6-af7a-4bcc-8202-2b537791f622 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:27.622570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0311ae6-af7a-4bcc-8202-2b537791f622 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:27.623150 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0311ae6-af7a-4bcc-8202-2b537791f622 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:27.775473 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e0311ae6-af7a-4bcc-8202-2b537791f622 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:27.783710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e0311ae6-af7a-4bcc-8202-2b537791f622 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.174535 May 24 13:01:27.784563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 107/225] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:27 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:27.860926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:27.861550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:27.869208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:27.869717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:27.870880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:27.871589 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:28.017462 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:28.026691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:28.028497 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:28.030461 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f23861f5-dcc5-497f-b9b2-50b16004f29a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.173978 May 24 13:01:28.031375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 119/226] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:27 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:28.607144 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aaa9f06e-11b6-4d09-8f7e-907c971b25bd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:28.607817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aaa9f06e-11b6-4d09-8f7e-907c971b25bd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:28.614256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aaa9f06e-11b6-4d09-8f7e-907c971b25bd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:28.614903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aaa9f06e-11b6-4d09-8f7e-907c971b25bd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:28.615540 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aaa9f06e-11b6-4d09-8f7e-907c971b25bd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:28.615976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aaa9f06e-11b6-4d09-8f7e-907c971b25bd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:28.787764 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-aaa9f06e-11b6-4d09-8f7e-907c971b25bd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:28.801495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5bc70ccb-fe54-41e1-8f6a-53a3ddcb8f01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:28.802468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5bc70ccb-fe54-41e1-8f6a-53a3ddcb8f01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:28.808129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aaa9f06e-11b6-4d09-8f7e-907c971b25bd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.196501 May 24 13:01:28.808825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 108/227] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:28 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:28.811541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5bc70ccb-fe54-41e1-8f6a-53a3ddcb8f01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:28.812284 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5bc70ccb-fe54-41e1-8f6a-53a3ddcb8f01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:28.813531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5bc70ccb-fe54-41e1-8f6a-53a3ddcb8f01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:28.814251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5bc70ccb-fe54-41e1-8f6a-53a3ddcb8f01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:28.979759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5bc70ccb-fe54-41e1-8f6a-53a3ddcb8f01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:28.988018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5bc70ccb-fe54-41e1-8f6a-53a3ddcb8f01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.190964 May 24 13:01:28.988595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 120/228] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:28 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:29.049501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:29.050124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:29.056935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:29.057618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:29.058529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:29.059132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:29.255294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:29.264184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:29.265687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:29.266823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-122e0013-7cce-4126-90a4-45157c2d6037 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.221503 May 24 13:01:29.277523 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 109/229] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:29 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:29.824777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7c67f08c-1816-47d0-8e92-97346e058e41 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:29.825915 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7c67f08c-1816-47d0-8e92-97346e058e41 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:29.832059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c67f08c-1816-47d0-8e92-97346e058e41 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:29.832512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c67f08c-1816-47d0-8e92-97346e058e41 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:29.833276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c67f08c-1816-47d0-8e92-97346e058e41 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:29.833711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c67f08c-1816-47d0-8e92-97346e058e41 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:29.961800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7c67f08c-1816-47d0-8e92-97346e058e41 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:29.969075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7c67f08c-1816-47d0-8e92-97346e058e41 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.148124 May 24 13:01:29.969643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 121/230] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:29 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:30.005080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d35f22a2-5435-4765-a9d7-2034c4080897 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:30.005692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d35f22a2-5435-4765-a9d7-2034c4080897 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:30.013039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35f22a2-5435-4765-a9d7-2034c4080897 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:30.013477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35f22a2-5435-4765-a9d7-2034c4080897 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:30.014231 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35f22a2-5435-4765-a9d7-2034c4080897 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:30.014702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35f22a2-5435-4765-a9d7-2034c4080897 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:30.147071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d35f22a2-5435-4765-a9d7-2034c4080897 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:30.154625 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d35f22a2-5435-4765-a9d7-2034c4080897 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.153426 May 24 13:01:30.155186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 110/231] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:30 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:30.284863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:30.285516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:30.292257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:30.292748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:30.293562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:30.294058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:30.444666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:30.455081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:30.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:30.457727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d188e3d8-b216-4b48-93cb-90734afa8287 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.176742 May 24 13:01:30.458267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 122/232] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:30 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:30.985414 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c5bba6cb-c80a-47b5-a71f-487d3f16beaf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:30.985936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c5bba6cb-c80a-47b5-a71f-487d3f16beaf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:30.991972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5bba6cb-c80a-47b5-a71f-487d3f16beaf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:30.993525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5bba6cb-c80a-47b5-a71f-487d3f16beaf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:30.993750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5bba6cb-c80a-47b5-a71f-487d3f16beaf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:30.994177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5bba6cb-c80a-47b5-a71f-487d3f16beaf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:31.118953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c5bba6cb-c80a-47b5-a71f-487d3f16beaf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:31.126989 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c5bba6cb-c80a-47b5-a71f-487d3f16beaf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.145520 May 24 13:01:31.127555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 111/233] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:30 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:31.171565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8d37d5cf-4e2f-49f5-a457-75ee40c677bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:31.172216 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8d37d5cf-4e2f-49f5-a457-75ee40c677bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:31.178218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d37d5cf-4e2f-49f5-a457-75ee40c677bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:31.178725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d37d5cf-4e2f-49f5-a457-75ee40c677bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:31.179516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d37d5cf-4e2f-49f5-a457-75ee40c677bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:31.179955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d37d5cf-4e2f-49f5-a457-75ee40c677bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:31.306909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8d37d5cf-4e2f-49f5-a457-75ee40c677bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:31.314272 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8d37d5cf-4e2f-49f5-a457-75ee40c677bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.146456 May 24 13:01:31.314864 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 123/234] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:31 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:31.476311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:31.476962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:31.483104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:31.483656 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:31.484292 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:31.484725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:31.782925 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:31.791591 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:31.793088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:31.794193 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0db13a14-fdcb-4188-934f-92fd4548be9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.322161 May 24 13:01:31.794911 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 112/235] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:31 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:32.143449 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-24926720-4158-4bfb-b80f-d6e8591581d9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:32.144065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-24926720-4158-4bfb-b80f-d6e8591581d9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:32.150628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24926720-4158-4bfb-b80f-d6e8591581d9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:32.151071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24926720-4158-4bfb-b80f-d6e8591581d9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:32.151824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24926720-4158-4bfb-b80f-d6e8591581d9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:32.152259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24926720-4158-4bfb-b80f-d6e8591581d9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:32.278092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-24926720-4158-4bfb-b80f-d6e8591581d9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:32.285503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-24926720-4158-4bfb-b80f-d6e8591581d9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.145926 May 24 13:01:32.286057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 124/236] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:32 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:32.330736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9f018119-dee4-4ed8-ac4e-46cce1fac5ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:32.331357 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9f018119-dee4-4ed8-ac4e-46cce1fac5ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:32.338123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f018119-dee4-4ed8-ac4e-46cce1fac5ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:32.338605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f018119-dee4-4ed8-ac4e-46cce1fac5ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:32.339370 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f018119-dee4-4ed8-ac4e-46cce1fac5ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:32.339807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f018119-dee4-4ed8-ac4e-46cce1fac5ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:32.466765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9f018119-dee4-4ed8-ac4e-46cce1fac5ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:32.474135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9f018119-dee4-4ed8-ac4e-46cce1fac5ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.147193 May 24 13:01:32.474730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 113/237] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:32 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:32.812535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:32.816062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:32.823281 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:32.823742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:32.824519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:32.824975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:32.956020 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:32.964985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:32.966532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:32.967630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-23a5ea57-37c1-4cdd-bc96-09dc94b01d68 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.159061 May 24 13:01:32.968184 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 125/238] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:32 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:32.999177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-125407062", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "networks": [{"uuid": "974075e8-4896-434f-8352-d3ab15000e1c"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:33.049662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] validate_networks() for [('974075e8-4896-434f-8352-d3ab15000e1c', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:01:33.302602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-097b6017-4a30-4935-9218-9453d3ae0ead tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:33.303215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-097b6017-4a30-4935-9218-9453d3ae0ead tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:33.309270 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-097b6017-4a30-4935-9218-9453d3ae0ead tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:33.309716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-097b6017-4a30-4935-9218-9453d3ae0ead tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:33.310520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-097b6017-4a30-4935-9218-9453d3ae0ead tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:33.310954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-097b6017-4a30-4935-9218-9453d3ae0ead tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:33.405098 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:01:33.405614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:01:33.406747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:01:33.406747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:01:33.407129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:01:33.420204 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:33.420661 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:33.421454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:33.421889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:33.441704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Getting quotas for project 6f2aa286c68c473686a4c71190684e18. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:01:33.447628 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Getting quotas for user 226c8c0918714060ac908316c7effc08 and project 6f2aa286c68c473686a4c71190684e18. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:01:33.462979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:01:33.463708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-097b6017-4a30-4935-9218-9453d3ae0ead tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:33.465821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:01:33.473186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-097b6017-4a30-4935-9218-9453d3ae0ead tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.174471 May 24 13:01:33.473957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 126/239] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:33 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:33.493420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e4a6736b-a588-4e4c-a66d-c6a16ad0b5c3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:33.494511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e4a6736b-a588-4e4c-a66d-c6a16ad0b5c3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:33.501307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e4a6736b-a588-4e4c-a66d-c6a16ad0b5c3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:33.501773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e4a6736b-a588-4e4c-a66d-c6a16ad0b5c3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:33.502565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e4a6736b-a588-4e4c-a66d-c6a16ad0b5c3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:33.503178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e4a6736b-a588-4e4c-a66d-c6a16ad0b5c3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:33.515048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b23a3e74-0af5-4e71-bb32-77fc9279bc57 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519566 May 24 13:01:33.515721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 114/240] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:01:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:01:33.527088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fb669ea3-540d-46e4-8d82-b7aac9d0bb58 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:33.527866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fb669ea3-540d-46e4-8d82-b7aac9d0bb58 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:33.639076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fb669ea3-540d-46e4-8d82-b7aac9d0bb58 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:33.649522 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fb669ea3-540d-46e4-8d82-b7aac9d0bb58 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1213 microversion: 2.1 time: 0.127088 May 24 13:01:33.651053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 115/241] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:33 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:33.665422 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-ad2b11e3-cb31-4b3e-bad9-72113fb62b84 req-232feed2-f26d-439e-846d-79816660d4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfc07c6-54c6-40b9-83bb-0343afadb737", "name": "network-vif-plugged", "status": "completed", "tag": "e281dabe-d4a2-4efa-97d5-a1ac6bcb3589"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:33.676055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ad2b11e3-cb31-4b3e-bad9-72113fb62b84 req-232feed2-f26d-439e-846d-79816660d4c5 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:33.676574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ad2b11e3-cb31-4b3e-bad9-72113fb62b84 req-232feed2-f26d-439e-846d-79816660d4c5 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:33.689228 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-ad2b11e3-cb31-4b3e-bad9-72113fb62b84 req-232feed2-f26d-439e-846d-79816660d4c5 service nova] Creating event network-vif-plugged:e281dabe-d4a2-4efa-97d5-a1ac6bcb3589 for instance ecfc07c6-54c6-40b9-83bb-0343afadb737 on hv-cinder-84301 May 24 13:01:33.695392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-ad2b11e3-cb31-4b3e-bad9-72113fb62b84 req-232feed2-f26d-439e-846d-79816660d4c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043034 May 24 13:01:33.698933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 116/242] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:01:33.717817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e4a6736b-a588-4e4c-a66d-c6a16ad0b5c3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:33.727642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e4a6736b-a588-4e4c-a66d-c6a16ad0b5c3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.240056 May 24 13:01:33.728293 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 127/243] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:33 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:33.987238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:33.988209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:33.995635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:33.996345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:33.997970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:33.998616 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:34.155385 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:34.164869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:34.166356 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:34.167481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b035f4c5-51ba-4c29-ab1c-4e13db4d8a37 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.185318 May 24 13:01:34.168055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 117/244] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:33 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:34.490869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b88d6fe1-cdf2-4aa8-bb4a-0af001999192 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:34.491508 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b88d6fe1-cdf2-4aa8-bb4a-0af001999192 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:34.497790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b88d6fe1-cdf2-4aa8-bb4a-0af001999192 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:34.498232 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b88d6fe1-cdf2-4aa8-bb4a-0af001999192 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:34.499007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b88d6fe1-cdf2-4aa8-bb4a-0af001999192 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:34.499443 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b88d6fe1-cdf2-4aa8-bb4a-0af001999192 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:34.625344 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b88d6fe1-cdf2-4aa8-bb4a-0af001999192 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:34.633294 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b88d6fe1-cdf2-4aa8-bb4a-0af001999192 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.145665 May 24 13:01:34.633851 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 128/245] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:34 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:34.667443 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1fafed78-a86f-49d9-a38f-11c427c9dd46 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:34.668132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1fafed78-a86f-49d9-a38f-11c427c9dd46 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:34.674882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fafed78-a86f-49d9-a38f-11c427c9dd46 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:34.675265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fafed78-a86f-49d9-a38f-11c427c9dd46 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:34.676024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fafed78-a86f-49d9-a38f-11c427c9dd46 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:34.676458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fafed78-a86f-49d9-a38f-11c427c9dd46 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:34.737697 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1fafed78-a86f-49d9-a38f-11c427c9dd46 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:34.744324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-57a55433-9a6a-4c47-9c3e-4752d12cf44f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:34.745146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-57a55433-9a6a-4c47-9c3e-4752d12cf44f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:34.745357 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1fafed78-a86f-49d9-a38f-11c427c9dd46 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1217 microversion: 2.1 time: 0.081729 May 24 13:01:34.745914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 118/246] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:34 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:34.751326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57a55433-9a6a-4c47-9c3e-4752d12cf44f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:34.751765 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57a55433-9a6a-4c47-9c3e-4752d12cf44f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:34.752514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57a55433-9a6a-4c47-9c3e-4752d12cf44f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:34.752944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57a55433-9a6a-4c47-9c3e-4752d12cf44f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:34.879312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-57a55433-9a6a-4c47-9c3e-4752d12cf44f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:34.881559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:34.888521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-57a55433-9a6a-4c47-9c3e-4752d12cf44f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.148008 May 24 13:01:34.889085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 129/247] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:34 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:35.185779 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:35.187184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:35.193730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:35.204121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:35.204121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:35.204121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:35.330867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:35.338775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:35.340303 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:35.341448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-58ceed4e-2a96-4b28-8199-a3f3340dacbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.159646 May 24 13:01:35.341997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 119/248] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:35 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:35.650157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f7fe388e-d518-4eaf-b172-2523b61e1026 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:35.650823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f7fe388e-d518-4eaf-b172-2523b61e1026 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:35.656831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f7fe388e-d518-4eaf-b172-2523b61e1026 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:35.657276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f7fe388e-d518-4eaf-b172-2523b61e1026 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:35.658023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f7fe388e-d518-4eaf-b172-2523b61e1026 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:35.658492 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f7fe388e-d518-4eaf-b172-2523b61e1026 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:35.762343 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-63d57557-2ab7-4f37-9c9f-c3c046b2b9a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:35.763014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-63d57557-2ab7-4f37-9c9f-c3c046b2b9a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:35.769692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63d57557-2ab7-4f37-9c9f-c3c046b2b9a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:35.770141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63d57557-2ab7-4f37-9c9f-c3c046b2b9a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:35.770939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63d57557-2ab7-4f37-9c9f-c3c046b2b9a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:35.771377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63d57557-2ab7-4f37-9c9f-c3c046b2b9a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:35.783483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f7fe388e-d518-4eaf-b172-2523b61e1026 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:35.791626 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f7fe388e-d518-4eaf-b172-2523b61e1026 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.145741 May 24 13:01:35.792224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 130/249] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:35 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:35.836373 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-63d57557-2ab7-4f37-9c9f-c3c046b2b9a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:35.843745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-63d57557-2ab7-4f37-9c9f-c3c046b2b9a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1217 microversion: 2.1 time: 0.085290 May 24 13:01:35.844326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 120/250] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:35 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:35.904921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-59476e6d-acc8-42a2-9959-8b4961ab70d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:35.905603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-59476e6d-acc8-42a2-9959-8b4961ab70d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:35.911755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59476e6d-acc8-42a2-9959-8b4961ab70d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:35.912218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59476e6d-acc8-42a2-9959-8b4961ab70d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:35.913024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59476e6d-acc8-42a2-9959-8b4961ab70d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:35.913488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59476e6d-acc8-42a2-9959-8b4961ab70d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:36.050650 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-59476e6d-acc8-42a2-9959-8b4961ab70d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:36.058882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-59476e6d-acc8-42a2-9959-8b4961ab70d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.157831 May 24 13:01:36.059452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 131/251] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:35 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:36.359783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:36.360417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:36.367435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:36.367886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:36.368652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:36.369083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:36.506043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:36.513890 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:36.515396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:36.516488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-53ea12a3-1437-4a62-8258-586840d77e34 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.160579 May 24 13:01:36.517033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 121/252] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:36 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:36.808882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a0cea16c-3aee-4d40-bfb8-68b965437765 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:36.809498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a0cea16c-3aee-4d40-bfb8-68b965437765 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:36.815737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0cea16c-3aee-4d40-bfb8-68b965437765 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:36.816188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0cea16c-3aee-4d40-bfb8-68b965437765 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:36.816954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0cea16c-3aee-4d40-bfb8-68b965437765 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:36.817392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0cea16c-3aee-4d40-bfb8-68b965437765 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:36.860892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-56093f00-795a-4e7e-9706-e383f07581b6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:36.861515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-56093f00-795a-4e7e-9706-e383f07581b6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:36.867983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-56093f00-795a-4e7e-9706-e383f07581b6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:36.868437 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-56093f00-795a-4e7e-9706-e383f07581b6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:36.869201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-56093f00-795a-4e7e-9706-e383f07581b6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:36.869637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-56093f00-795a-4e7e-9706-e383f07581b6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:36.873900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:36.931772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-56093f00-795a-4e7e-9706-e383f07581b6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:36.939106 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-56093f00-795a-4e7e-9706-e383f07581b6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1217 microversion: 2.1 time: 0.082067 May 24 13:01:36.939864 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 122/253] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:36 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:36.944187 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a0cea16c-3aee-4d40-bfb8-68b965437765 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:36.951689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a0cea16c-3aee-4d40-bfb8-68b965437765 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.147277 May 24 13:01:36.952252 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 132/254] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:36 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:37.074949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4c4845a1-65eb-41c0-b764-f3ea440a2915 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:37.075553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4c4845a1-65eb-41c0-b764-f3ea440a2915 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:37.081870 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c4845a1-65eb-41c0-b764-f3ea440a2915 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:37.082334 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c4845a1-65eb-41c0-b764-f3ea440a2915 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:37.083087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c4845a1-65eb-41c0-b764-f3ea440a2915 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:37.083542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c4845a1-65eb-41c0-b764-f3ea440a2915 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:37.213734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4c4845a1-65eb-41c0-b764-f3ea440a2915 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:37.221100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4c4845a1-65eb-41c0-b764-f3ea440a2915 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.150099 May 24 13:01:37.221652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 123/255] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:37 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:37.534198 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:37.534857 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:37.540936 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:37.541385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:37.542180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:37.542641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:37.672182 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:37.680750 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:37.682343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:37.683477 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-edaa3e16-6d0c-4b8e-a96d-66c4c8caa02c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.153114 May 24 13:01:37.684029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 133/256] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:37 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:37.956152 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-83a3f6d7-ab6e-478f-a4cd-951ddcc85f24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:37.956699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-83a3f6d7-ab6e-478f-a4cd-951ddcc85f24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:37.963763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83a3f6d7-ab6e-478f-a4cd-951ddcc85f24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:37.964202 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83a3f6d7-ab6e-478f-a4cd-951ddcc85f24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:37.964953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83a3f6d7-ab6e-478f-a4cd-951ddcc85f24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:37.965379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83a3f6d7-ab6e-478f-a4cd-951ddcc85f24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:37.968021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c0b59149-4090-40fd-b169-a94cf341dd33 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:37.968639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c0b59149-4090-40fd-b169-a94cf341dd33 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:37.974673 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0b59149-4090-40fd-b169-a94cf341dd33 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:37.975126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0b59149-4090-40fd-b169-a94cf341dd33 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:37.975918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0b59149-4090-40fd-b169-a94cf341dd33 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:37.976354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0b59149-4090-40fd-b169-a94cf341dd33 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:38.026707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-83a3f6d7-ab6e-478f-a4cd-951ddcc85f24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:38.034137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-83a3f6d7-ab6e-478f-a4cd-951ddcc85f24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1217 microversion: 2.1 time: 0.081897 May 24 13:01:38.034948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 124/257] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:37 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:38.101200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c0b59149-4090-40fd-b169-a94cf341dd33 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:38.108620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c0b59149-4090-40fd-b169-a94cf341dd33 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.144573 May 24 13:01:38.109178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 134/258] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:37 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:38.236885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fdd9817f-2315-404a-a428-d8b2dbe8b3d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:38.237411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fdd9817f-2315-404a-a428-d8b2dbe8b3d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:38.243382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdd9817f-2315-404a-a428-d8b2dbe8b3d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:38.243831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdd9817f-2315-404a-a428-d8b2dbe8b3d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:38.244589 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdd9817f-2315-404a-a428-d8b2dbe8b3d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:38.245028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdd9817f-2315-404a-a428-d8b2dbe8b3d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:38.370779 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fdd9817f-2315-404a-a428-d8b2dbe8b3d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:38.379361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fdd9817f-2315-404a-a428-d8b2dbe8b3d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.146436 May 24 13:01:38.379922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 125/259] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:38 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:38.701695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:38.702473 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:38.708614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:38.709062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:38.709883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:38.710357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:38.840133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:38.848081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:38.849592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:38.850772 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c1741bd5-13e9-4de7-a63d-68936a6b5967 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.152901 May 24 13:01:38.851347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 135/260] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:38 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:39.050922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cbd08a5a-36bc-44d4-8896-7b86b5f38182 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:39.051525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cbd08a5a-36bc-44d4-8896-7b86b5f38182 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:39.058547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cbd08a5a-36bc-44d4-8896-7b86b5f38182 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:39.058997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cbd08a5a-36bc-44d4-8896-7b86b5f38182 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:39.059754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cbd08a5a-36bc-44d4-8896-7b86b5f38182 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:39.060188 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cbd08a5a-36bc-44d4-8896-7b86b5f38182 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:39.123283 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cbd08a5a-36bc-44d4-8896-7b86b5f38182 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:39.125160 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-462b54e9-fa8f-4063-b9ea-5464618905e7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:39.125768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-462b54e9-fa8f-4063-b9ea-5464618905e7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:39.130914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cbd08a5a-36bc-44d4-8896-7b86b5f38182 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1217 microversion: 2.1 time: 0.083909 May 24 13:01:39.131607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 126/261] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:39 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:39.131724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-462b54e9-fa8f-4063-b9ea-5464618905e7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:39.132093 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-462b54e9-fa8f-4063-b9ea-5464618905e7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:39.132917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-462b54e9-fa8f-4063-b9ea-5464618905e7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:39.133349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-462b54e9-fa8f-4063-b9ea-5464618905e7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:39.255591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-462b54e9-fa8f-4063-b9ea-5464618905e7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:39.263068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-462b54e9-fa8f-4063-b9ea-5464618905e7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.141981 May 24 13:01:39.263632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 136/262] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:39 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:39.397135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a24cfbc4-1d07-4860-be51-0450a4c68d47 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:39.397737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a24cfbc4-1d07-4860-be51-0450a4c68d47 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:39.406058 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a24cfbc4-1d07-4860-be51-0450a4c68d47 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:39.406796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a24cfbc4-1d07-4860-be51-0450a4c68d47 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:39.407855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a24cfbc4-1d07-4860-be51-0450a4c68d47 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:39.408006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a24cfbc4-1d07-4860-be51-0450a4c68d47 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:39.547657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a24cfbc4-1d07-4860-be51-0450a4c68d47 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:39.555315 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a24cfbc4-1d07-4860-be51-0450a4c68d47 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.162337 May 24 13:01:39.555921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 127/263] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:39 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:39.868241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:39.868852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:39.875129 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:39.875578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:39.876336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:39.876777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:40.012900 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:40.020965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:40.022510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:40.024204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2fd3056f-d9bf-4b21-9bc9-924b02c9c53e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.159978 May 24 13:01:40.024760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 137/264] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:39 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:40.149486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2c2fbd5c-776f-41ec-a556-ef7d06a8ad8d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:40.150092 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2c2fbd5c-776f-41ec-a556-ef7d06a8ad8d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:40.157505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c2fbd5c-776f-41ec-a556-ef7d06a8ad8d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:40.157949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c2fbd5c-776f-41ec-a556-ef7d06a8ad8d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:40.158966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c2fbd5c-776f-41ec-a556-ef7d06a8ad8d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:40.159398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c2fbd5c-776f-41ec-a556-ef7d06a8ad8d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:40.222811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2c2fbd5c-776f-41ec-a556-ef7d06a8ad8d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:40.230775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2c2fbd5c-776f-41ec-a556-ef7d06a8ad8d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1209 microversion: 2.1 time: 0.085021 May 24 13:01:40.231508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 128/265] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:40 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:40.279385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-33571ae3-2fca-469d-9a25-71da77d0e14d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:40.280126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-33571ae3-2fca-469d-9a25-71da77d0e14d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:40.286252 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33571ae3-2fca-469d-9a25-71da77d0e14d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:40.286735 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33571ae3-2fca-469d-9a25-71da77d0e14d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:40.287532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33571ae3-2fca-469d-9a25-71da77d0e14d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:40.287984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33571ae3-2fca-469d-9a25-71da77d0e14d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:40.418164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-33571ae3-2fca-469d-9a25-71da77d0e14d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:40.425540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-33571ae3-2fca-469d-9a25-71da77d0e14d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.150115 May 24 13:01:40.426106 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 138/266] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:40 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:40.572110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-038a6657-6fbd-4d54-8031-4435848746b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:40.572721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-038a6657-6fbd-4d54-8031-4435848746b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:40.578680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a6657-6fbd-4d54-8031-4435848746b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:40.579129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a6657-6fbd-4d54-8031-4435848746b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:40.579886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a6657-6fbd-4d54-8031-4435848746b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:40.580321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a6657-6fbd-4d54-8031-4435848746b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:40.721062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-038a6657-6fbd-4d54-8031-4435848746b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:40.730478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-038a6657-6fbd-4d54-8031-4435848746b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1364 microversion: 2.1 time: 0.162163 May 24 13:01:40.732201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 129/267] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:40 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:40.905374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-a8a80185-81bb-4dfb-8d15-e88edf7fbcf1 req-63a45a1b-1e03-457c-84c7-55bcd4c434d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d64168-bd90-4c29-bb47-7d69d4c12f4a", "name": "network-vif-plugged", "status": "completed", "tag": "b856b728-8b89-4bce-b61b-c056d80281f4"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:40.920699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-a8a80185-81bb-4dfb-8d15-e88edf7fbcf1 req-63a45a1b-1e03-457c-84c7-55bcd4c434d6 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:40.920699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-a8a80185-81bb-4dfb-8d15-e88edf7fbcf1 req-63a45a1b-1e03-457c-84c7-55bcd4c434d6 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:40.931779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-a8a80185-81bb-4dfb-8d15-e88edf7fbcf1 req-63a45a1b-1e03-457c-84c7-55bcd4c434d6 service nova] Creating event network-vif-plugged:b856b728-8b89-4bce-b61b-c056d80281f4 for instance c3d64168-bd90-4c29-bb47-7d69d4c12f4a on hv-cinder-84301 May 24 13:01:40.952746 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-a8a80185-81bb-4dfb-8d15-e88edf7fbcf1 req-63a45a1b-1e03-457c-84c7-55bcd4c434d6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048715 May 24 13:01:40.953657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 139/268] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:01:41.043511 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:41.044841 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:41.051204 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:41.051654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:41.052608 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:41.053191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:41.212718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:41.221580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:41.223940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:41.224942 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f1a01ad5-117a-4689-a91e-c68441fbdb70 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.185688 May 24 13:01:41.225507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 130/269] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:41 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:41.249455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ab1dac41-ee04-45d3-8908-6cc613a196db tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:41.250150 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ab1dac41-ee04-45d3-8908-6cc613a196db tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:41.260208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ab1dac41-ee04-45d3-8908-6cc613a196db tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:41.260666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ab1dac41-ee04-45d3-8908-6cc613a196db tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:41.261831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ab1dac41-ee04-45d3-8908-6cc613a196db tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:41.262375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ab1dac41-ee04-45d3-8908-6cc613a196db tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:41.415488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ab1dac41-ee04-45d3-8908-6cc613a196db tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:41.424264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ab1dac41-ee04-45d3-8908-6cc613a196db tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1209 microversion: 2.1 time: 0.179098 May 24 13:01:41.424835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 140/270] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:41 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1209 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:41.442258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0c42d3a0-7b00-4b42-9f3c-6108e48e0a08 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:41.443021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0c42d3a0-7b00-4b42-9f3c-6108e48e0a08 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:41.449415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c42d3a0-7b00-4b42-9f3c-6108e48e0a08 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:41.449952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c42d3a0-7b00-4b42-9f3c-6108e48e0a08 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:41.450895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c42d3a0-7b00-4b42-9f3c-6108e48e0a08 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:41.451487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c42d3a0-7b00-4b42-9f3c-6108e48e0a08 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:41.651713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0c42d3a0-7b00-4b42-9f3c-6108e48e0a08 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:41.659108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0c42d3a0-7b00-4b42-9f3c-6108e48e0a08 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.221089 May 24 13:01:41.659667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 131/271] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:41 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:41.748645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dbe4bf7d-53f4-4151-a86f-7153a4776f93 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:41.749267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dbe4bf7d-53f4-4151-a86f-7153a4776f93 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:41.755413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbe4bf7d-53f4-4151-a86f-7153a4776f93 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:41.755859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbe4bf7d-53f4-4151-a86f-7153a4776f93 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:41.756613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbe4bf7d-53f4-4151-a86f-7153a4776f93 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:41.757043 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbe4bf7d-53f4-4151-a86f-7153a4776f93 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:41.972969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dbe4bf7d-53f4-4151-a86f-7153a4776f93 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:41.981074 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dbe4bf7d-53f4-4151-a86f-7153a4776f93 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1549 microversion: 2.1 time: 0.236269 May 24 13:01:41.981641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 141/272] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:41 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1549 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:41.998168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc22fde9-a4da-45e5-958e-571fc2cc0acb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:41.998694 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cc22fde9-a4da-45e5-958e-571fc2cc0acb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:42.004716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc22fde9-a4da-45e5-958e-571fc2cc0acb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:42.005166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc22fde9-a4da-45e5-958e-571fc2cc0acb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:42.005923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc22fde9-a4da-45e5-958e-571fc2cc0acb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:42.006541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc22fde9-a4da-45e5-958e-571fc2cc0acb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:42.100710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cc22fde9-a4da-45e5-958e-571fc2cc0acb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106861 May 24 13:01:42.101355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 132/273] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 13:01:41 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:01:42.243498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:42.244120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:42.250845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:42.251292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:42.252261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:42.252690 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:42.442450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-86599469-d1b5-4ff5-8f90-0be160a055b8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:42.443686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-86599469-d1b5-4ff5-8f90-0be160a055b8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:42.450187 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86599469-d1b5-4ff5-8f90-0be160a055b8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:42.451080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86599469-d1b5-4ff5-8f90-0be160a055b8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:42.452016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86599469-d1b5-4ff5-8f90-0be160a055b8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:42.452451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86599469-d1b5-4ff5-8f90-0be160a055b8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:42.518848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-86599469-d1b5-4ff5-8f90-0be160a055b8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:42.527512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-86599469-d1b5-4ff5-8f90-0be160a055b8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1265 microversion: 2.1 time: 0.090445 May 24 13:01:42.528076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 133/274] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:42 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:42.650915 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:42.659062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:42.660581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:42.663652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-527bbe68-dee8-48c0-bf0f-31b6b212d26c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.424139 May 24 13:01:42.664536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 142/275] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:42 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:42.679963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6bb880ef-b866-40a8-962f-4d8b54957848 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:42.680568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6bb880ef-b866-40a8-962f-4d8b54957848 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:42.686831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bb880ef-b866-40a8-962f-4d8b54957848 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:42.687282 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bb880ef-b866-40a8-962f-4d8b54957848 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:42.688249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bb880ef-b866-40a8-962f-4d8b54957848 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:42.688682 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bb880ef-b866-40a8-962f-4d8b54957848 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:42.835852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6bb880ef-b866-40a8-962f-4d8b54957848 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:42.844379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6bb880ef-b866-40a8-962f-4d8b54957848 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.168735 May 24 13:01:42.844940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 134/276] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:42 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:43.545375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-59ea1e38-e2ba-4a92-b028-796b3a26d724 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:43.546336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-59ea1e38-e2ba-4a92-b028-796b3a26d724 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:43.558341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59ea1e38-e2ba-4a92-b028-796b3a26d724 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:43.563093 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59ea1e38-e2ba-4a92-b028-796b3a26d724 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:43.563916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59ea1e38-e2ba-4a92-b028-796b3a26d724 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:43.564362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59ea1e38-e2ba-4a92-b028-796b3a26d724 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:43.567008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-a9e98290-37c2-49fd-b345-3e0d4f728680 req-86d6de8d-0a56-449c-9f9c-4fd8b465a7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6db3c9-4cac-4157-ba43-3c425854302d", "tag": "59643b71-d317-4922-9d19-0298524e0346"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:43.572439 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:43.579313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a9e98290-37c2-49fd-b345-3e0d4f728680 req-86d6de8d-0a56-449c-9f9c-4fd8b465a7b1 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:43.579759 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a9e98290-37c2-49fd-b345-3e0d4f728680 req-86d6de8d-0a56-449c-9f9c-4fd8b465a7b1 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:43.602952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-a9e98290-37c2-49fd-b345-3e0d4f728680 req-86d6de8d-0a56-449c-9f9c-4fd8b465a7b1 service nova] Creating event network-changed:59643b71-d317-4922-9d19-0298524e0346 for instance dc6db3c9-4cac-4157-ba43-3c425854302d on hv-cinder-84301 May 24 13:01:43.608086 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-a9e98290-37c2-49fd-b345-3e0d4f728680 req-86d6de8d-0a56-449c-9f9c-4fd8b465a7b1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044492 May 24 13:01:43.608990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 135/277] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:01:43.646248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-59ea1e38-e2ba-4a92-b028-796b3a26d724 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:43.655224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-59ea1e38-e2ba-4a92-b028-796b3a26d724 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1265 microversion: 2.1 time: 0.114304 May 24 13:01:43.659986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 143/278] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:43 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:43.678859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=8 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:43.683782 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:43.684714 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:43.691794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:43.692241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:43.693000 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:43.693611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:43.839583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:43.851720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:43.856050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:43.857966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ad830795-e570-45ba-af2f-f23602f7e790 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.180430 May 24 13:01:43.863478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6af3a239-94ec-444b-859f-f2a34657aafc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:43.863478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6af3a239-94ec-444b-859f-f2a34657aafc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:43.865124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 136/279] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:43 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:43.869001 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6af3a239-94ec-444b-859f-f2a34657aafc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:43.869637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6af3a239-94ec-444b-859f-f2a34657aafc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:43.870622 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6af3a239-94ec-444b-859f-f2a34657aafc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:43.871331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6af3a239-94ec-444b-859f-f2a34657aafc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:44.023291 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6af3a239-94ec-444b-859f-f2a34657aafc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:44.031911 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6af3a239-94ec-444b-859f-f2a34657aafc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.174377 May 24 13:01:44.037029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 144/280] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:43 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:44.672578 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-397f2d0f-4cc4-46ba-a864-9da240c4f480 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:44.673226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-397f2d0f-4cc4-46ba-a864-9da240c4f480 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:44.680761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-397f2d0f-4cc4-46ba-a864-9da240c4f480 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:44.681523 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-397f2d0f-4cc4-46ba-a864-9da240c4f480 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:44.682330 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-397f2d0f-4cc4-46ba-a864-9da240c4f480 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:44.682919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-397f2d0f-4cc4-46ba-a864-9da240c4f480 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:44.749949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-397f2d0f-4cc4-46ba-a864-9da240c4f480 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:44.760075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-397f2d0f-4cc4-46ba-a864-9da240c4f480 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1265 microversion: 2.1 time: 0.091261 May 24 13:01:44.760668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 137/281] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:44 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:44.876460 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:44.877071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:44.883882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:44.884327 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:44.885086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:44.885754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:45.035803 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:45.050013 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b71cb5ff-1b0b-4853-b697-f814be8363f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:45.051118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b71cb5ff-1b0b-4853-b697-f814be8363f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:45.053116 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:45.061916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:45.065587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b71cb5ff-1b0b-4853-b697-f814be8363f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:45.066104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:45.066780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b71cb5ff-1b0b-4853-b697-f814be8363f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:45.067897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0dca4a18-6db9-4a80-8a0b-1c3244968d1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.195626 May 24 13:01:45.068753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b71cb5ff-1b0b-4853-b697-f814be8363f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:45.069256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b71cb5ff-1b0b-4853-b697-f814be8363f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:45.073539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 145/282] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:44 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:45.226234 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b71cb5ff-1b0b-4853-b697-f814be8363f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:45.234583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b71cb5ff-1b0b-4853-b697-f814be8363f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.188223 May 24 13:01:45.235162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 138/283] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:45 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:45.776506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-44d202d6-b3a9-41ac-9568-d4f114f125cd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:45.777821 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-44d202d6-b3a9-41ac-9568-d4f114f125cd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:45.784068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44d202d6-b3a9-41ac-9568-d4f114f125cd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:45.784607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44d202d6-b3a9-41ac-9568-d4f114f125cd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:45.785379 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44d202d6-b3a9-41ac-9568-d4f114f125cd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:45.785815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44d202d6-b3a9-41ac-9568-d4f114f125cd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:45.861961 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-44d202d6-b3a9-41ac-9568-d4f114f125cd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:45.870656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-44d202d6-b3a9-41ac-9568-d4f114f125cd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1265 microversion: 2.1 time: 0.097831 May 24 13:01:45.871657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 146/284] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:45 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:46.087774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:46.088521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:46.097340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:46.097793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:46.098631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:46.099069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:46.264015 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0dc4310f-b94a-4084-8c0d-61b8a0fc0a50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:46.265274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0dc4310f-b94a-4084-8c0d-61b8a0fc0a50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:46.271857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:46.273409 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dc4310f-b94a-4084-8c0d-61b8a0fc0a50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:46.274595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dc4310f-b94a-4084-8c0d-61b8a0fc0a50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:46.277223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dc4310f-b94a-4084-8c0d-61b8a0fc0a50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:46.277673 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dc4310f-b94a-4084-8c0d-61b8a0fc0a50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:46.283406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:46.304345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:46.312291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:46.327856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:46.337546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b411444-4b1d-40a0-89b0-516c790f2ce9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1406 microversion: 2.20 time: 0.250316 May 24 13:01:46.338236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 139/285] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:46 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:01:46.483616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0dc4310f-b94a-4084-8c0d-61b8a0fc0a50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:46.492292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0dc4310f-b94a-4084-8c0d-61b8a0fc0a50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.238025 May 24 13:01:46.493431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 147/286] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:46 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:46.892903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5c7e45a9-5e44-4380-9b5d-e1d4f765976f tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:46.893386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5c7e45a9-5e44-4380-9b5d-e1d4f765976f tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:46.907187 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c7e45a9-5e44-4380-9b5d-e1d4f765976f tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:46.907652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c7e45a9-5e44-4380-9b5d-e1d4f765976f tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:46.908507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c7e45a9-5e44-4380-9b5d-e1d4f765976f tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:46.908963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c7e45a9-5e44-4380-9b5d-e1d4f765976f tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:46.984698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5c7e45a9-5e44-4380-9b5d-e1d4f765976f tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:46.992430 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5c7e45a9-5e44-4380-9b5d-e1d4f765976f tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1273 microversion: 2.1 time: 0.107108 May 24 13:01:46.992987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 140/287] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:46 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:47.356286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:47.356907 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:47.363039 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.363499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.364264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.364973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.510536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ebbfb452-c1f0-4a07-b7e3-b3c4ed3ee1a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:47.510536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ebbfb452-c1f0-4a07-b7e3-b3c4ed3ee1a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:47.515395 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:47.517235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebbfb452-c1f0-4a07-b7e3-b3c4ed3ee1a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.517689 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebbfb452-c1f0-4a07-b7e3-b3c4ed3ee1a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.518499 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebbfb452-c1f0-4a07-b7e3-b3c4ed3ee1a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.518940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebbfb452-c1f0-4a07-b7e3-b3c4ed3ee1a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.526095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:47.528926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:47.530320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3a4704e7-9899-4777-a2e0-5aef6cb81f6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1598 microversion: 2.20 time: 0.177914 May 24 13:01:47.531021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 148/288] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:01:47 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:01:47.544205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c9c9f81c-ad70-4ed5-bd65-38b556e16a95 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:47.544869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c9c9f81c-ad70-4ed5-bd65-38b556e16a95 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:47.551374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9c9f81c-ad70-4ed5-bd65-38b556e16a95 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.551767 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9c9f81c-ad70-4ed5-bd65-38b556e16a95 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.553459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9c9f81c-ad70-4ed5-bd65-38b556e16a95 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.554684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9c9f81c-ad70-4ed5-bd65-38b556e16a95 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.584181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c9c9f81c-ad70-4ed5-bd65-38b556e16a95 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Going to try to terminate instance {{(pid=117643) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:01:47.670703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ebbfb452-c1f0-4a07-b7e3-b3c4ed3ee1a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:47.680171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ebbfb452-c1f0-4a07-b7e3-b3c4ed3ee1a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.174815 May 24 13:01:47.690444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 141/289] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:47 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:47.694739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-621f1165-f0d1-4dff-9016-c0b19b301e13 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:47.695248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-621f1165-f0d1-4dff-9016-c0b19b301e13 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:47.704801 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-621f1165-f0d1-4dff-9016-c0b19b301e13 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.705611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-621f1165-f0d1-4dff-9016-c0b19b301e13 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.706622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-621f1165-f0d1-4dff-9016-c0b19b301e13 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.707252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-621f1165-f0d1-4dff-9016-c0b19b301e13 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.750676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c9c9f81c-ad70-4ed5-bd65-38b556e16a95 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 204 len: 0 microversion: 2.1 time: 0.218150 May 24 13:01:47.751156 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 149/290] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:01:47 2022] DELETE /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:01:47.759596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0bda44ff-53ff-4f8e-9815-aebeff1bff29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:47.760301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0bda44ff-53ff-4f8e-9815-aebeff1bff29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:47.766423 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bda44ff-53ff-4f8e-9815-aebeff1bff29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.766875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bda44ff-53ff-4f8e-9815-aebeff1bff29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.767642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bda44ff-53ff-4f8e-9815-aebeff1bff29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:47.768174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bda44ff-53ff-4f8e-9815-aebeff1bff29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:47.799695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-621f1165-f0d1-4dff-9016-c0b19b301e13 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.109856 May 24 13:01:47.800417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 142/291] 10.222.0.45 () {60 vars in 1315 bytes} [Tue May 24 13:01:47 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:01:47.911095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0bda44ff-53ff-4f8e-9815-aebeff1bff29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:47.925279 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0bda44ff-53ff-4f8e-9815-aebeff1bff29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1553 microversion: 2.1 time: 0.168432 May 24 13:01:47.926063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 150/292] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:47 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:48.011624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-058fb531-f189-45d8-989b-6485c4ef8b1a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:48.012714 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-058fb531-f189-45d8-989b-6485c4ef8b1a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:48.027127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-058fb531-f189-45d8-989b-6485c4ef8b1a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:48.027567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-058fb531-f189-45d8-989b-6485c4ef8b1a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:48.028554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-058fb531-f189-45d8-989b-6485c4ef8b1a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:48.029336 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-058fb531-f189-45d8-989b-6485c4ef8b1a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:48.158240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-058fb531-f189-45d8-989b-6485c4ef8b1a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:48.167901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-058fb531-f189-45d8-989b-6485c4ef8b1a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1271 microversion: 2.1 time: 0.161064 May 24 13:01:48.168522 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 143/293] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:48 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:48.704955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-03f3c366-5251-48e0-a2f0-8743850fa80e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:48.705566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-03f3c366-5251-48e0-a2f0-8743850fa80e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:48.714960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03f3c366-5251-48e0-a2f0-8743850fa80e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:48.715708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03f3c366-5251-48e0-a2f0-8743850fa80e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:48.716993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03f3c366-5251-48e0-a2f0-8743850fa80e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:48.717493 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03f3c366-5251-48e0-a2f0-8743850fa80e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:48.943361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-503aade4-ad5c-452e-9a2f-5a04ea69d6bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:48.945047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-503aade4-ad5c-452e-9a2f-5a04ea69d6bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:48.951898 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-503aade4-ad5c-452e-9a2f-5a04ea69d6bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:48.952668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-503aade4-ad5c-452e-9a2f-5a04ea69d6bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:48.953601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-503aade4-ad5c-452e-9a2f-5a04ea69d6bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:48.954190 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-503aade4-ad5c-452e-9a2f-5a04ea69d6bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:49.039563 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-03f3c366-5251-48e0-a2f0-8743850fa80e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:49.047935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-03f3c366-5251-48e0-a2f0-8743850fa80e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1322 microversion: 2.1 time: 0.346822 May 24 13:01:49.048666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 151/294] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:48 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:49.189428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2043ace3-9b4d-475c-9a20-b9427923c9d0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:49.190578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2043ace3-9b4d-475c-9a20-b9427923c9d0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:49.217686 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2043ace3-9b4d-475c-9a20-b9427923c9d0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:49.222518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2043ace3-9b4d-475c-9a20-b9427923c9d0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:49.235242 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2043ace3-9b4d-475c-9a20-b9427923c9d0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:49.235994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2043ace3-9b4d-475c-9a20-b9427923c9d0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:49.256386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-503aade4-ad5c-452e-9a2f-5a04ea69d6bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:49.273049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-503aade4-ad5c-452e-9a2f-5a04ea69d6bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1553 microversion: 2.1 time: 0.333578 May 24 13:01:49.274053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 144/295] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:48 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1553 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:49.355145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2043ace3-9b4d-475c-9a20-b9427923c9d0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:49.364774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2043ace3-9b4d-475c-9a20-b9427923c9d0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1271 microversion: 2.1 time: 0.183729 May 24 13:01:49.365431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 152/296] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:49 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:49.617228 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-53cdbe19-9550-4db7-af89-8b861586912d req-e71bf3d5-a08b-4d65-9518-f4c285f323a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dbd25ed-5661-4c08-949c-27204c6c1172", "tag": "d4232814-2adb-4fc6-bd44-4cb7c7da4de1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:49.627251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-53cdbe19-9550-4db7-af89-8b861586912d req-e71bf3d5-a08b-4d65-9518-f4c285f323a0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:49.627963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-53cdbe19-9550-4db7-af89-8b861586912d req-e71bf3d5-a08b-4d65-9518-f4c285f323a0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:49.641527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-53cdbe19-9550-4db7-af89-8b861586912d req-e71bf3d5-a08b-4d65-9518-f4c285f323a0 service nova] Creating event network-changed:d4232814-2adb-4fc6-bd44-4cb7c7da4de1 for instance 8dbd25ed-5661-4c08-949c-27204c6c1172 on hv-cinder-84301 May 24 13:01:49.647958 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-53cdbe19-9550-4db7-af89-8b861586912d req-e71bf3d5-a08b-4d65-9518-f4c285f323a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034633 May 24 13:01:49.649506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 145/297] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:01:50.064949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-26af4c72-58de-4915-a88d-7188d3bb9651 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:50.065569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-26af4c72-58de-4915-a88d-7188d3bb9651 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:50.071639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-26af4c72-58de-4915-a88d-7188d3bb9651 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.072088 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-26af4c72-58de-4915-a88d-7188d3bb9651 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.073062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-26af4c72-58de-4915-a88d-7188d3bb9651 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.073503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-26af4c72-58de-4915-a88d-7188d3bb9651 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.265771 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-26af4c72-58de-4915-a88d-7188d3bb9651 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:50.280709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-26af4c72-58de-4915-a88d-7188d3bb9651 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1516 microversion: 2.1 time: 0.219489 May 24 13:01:50.281784 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 153/298] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:50 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:50.304719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9acb70b0-6df8-4b00-a265-68c8c14b2e50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:50.306361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9acb70b0-6df8-4b00-a265-68c8c14b2e50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:50.309894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-da47821f-0f81-4b4e-8c3e-b5cf5736c698 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:50.315051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9acb70b0-6df8-4b00-a265-68c8c14b2e50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.315713 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9acb70b0-6df8-4b00-a265-68c8c14b2e50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.316619 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9acb70b0-6df8-4b00-a265-68c8c14b2e50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.317136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9acb70b0-6df8-4b00-a265-68c8c14b2e50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.328135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-da47821f-0f81-4b4e-8c3e-b5cf5736c698 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:50.343753 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-9acb70b0-6df8-4b00-a265-68c8c14b2e50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lazy-loading 'flavor' on Instance uuid c3d64168-bd90-4c29-bb47-7d69d4c12f4a {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:01:50.345910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da47821f-0f81-4b4e-8c3e-b5cf5736c698 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.354540 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da47821f-0f81-4b4e-8c3e-b5cf5736c698 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.355666 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da47821f-0f81-4b4e-8c3e-b5cf5736c698 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.356268 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da47821f-0f81-4b4e-8c3e-b5cf5736c698 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.505991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9acb70b0-6df8-4b00-a265-68c8c14b2e50 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a/action" status: 200 len: 32 microversion: 2.1 time: 0.207529 May 24 13:01:50.508730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 154/299] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:01:50 2022] POST /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 13:01:50.517716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4669fabc-6f0a-41b1-b53d-a1e95f557695 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:50.518095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4669fabc-6f0a-41b1-b53d-a1e95f557695 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:50.530111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4669fabc-6f0a-41b1-b53d-a1e95f557695 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.532181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4669fabc-6f0a-41b1-b53d-a1e95f557695 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.533871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4669fabc-6f0a-41b1-b53d-a1e95f557695 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.534842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4669fabc-6f0a-41b1-b53d-a1e95f557695 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.612962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-da47821f-0f81-4b4e-8c3e-b5cf5736c698 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:50.634175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-da47821f-0f81-4b4e-8c3e-b5cf5736c698 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1553 microversion: 2.1 time: 0.343612 May 24 13:01:50.636198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 146/300] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:50 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1553 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:50.642781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e8772639-7b25-42fe-940e-b28aac942292 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:50.643703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e8772639-7b25-42fe-940e-b28aac942292 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:50.655842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8772639-7b25-42fe-940e-b28aac942292 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.656562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8772639-7b25-42fe-940e-b28aac942292 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.657424 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8772639-7b25-42fe-940e-b28aac942292 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:50.657932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8772639-7b25-42fe-940e-b28aac942292 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:50.729278 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-4669fabc-6f0a-41b1-b53d-a1e95f557695 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:50.737289 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4669fabc-6f0a-41b1-b53d-a1e95f557695 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.226495 May 24 13:01:50.738083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 155/301] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:50 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:50.866953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e8772639-7b25-42fe-940e-b28aac942292 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:50.876409 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e8772639-7b25-42fe-940e-b28aac942292 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.236662 May 24 13:01:50.877005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 147/302] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:50 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:51.651954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-71ae1deb-530d-420f-a057-c763d148bcfc tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:51.652668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-71ae1deb-530d-420f-a057-c763d148bcfc tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:51.658732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71ae1deb-530d-420f-a057-c763d148bcfc tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:51.659181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71ae1deb-530d-420f-a057-c763d148bcfc tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:51.659987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71ae1deb-530d-420f-a057-c763d148bcfc tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:51.660404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71ae1deb-530d-420f-a057-c763d148bcfc tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:51.755302 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9b8ab853-e339-43f0-91ac-abc88bbfa732 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:51.755915 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9b8ab853-e339-43f0-91ac-abc88bbfa732 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:51.763413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b8ab853-e339-43f0-91ac-abc88bbfa732 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:51.764060 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b8ab853-e339-43f0-91ac-abc88bbfa732 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:51.764858 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b8ab853-e339-43f0-91ac-abc88bbfa732 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:51.765287 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b8ab853-e339-43f0-91ac-abc88bbfa732 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:51.793154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-71ae1deb-530d-420f-a057-c763d148bcfc tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:51.802152 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-71ae1deb-530d-420f-a057-c763d148bcfc tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1553 microversion: 2.1 time: 0.154549 May 24 13:01:51.802873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 156/303] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:51 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:51.893298 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-28b1d0d7-4555-4366-850f-5bc6592d515f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:51.894307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-28b1d0d7-4555-4366-850f-5bc6592d515f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:51.900543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-28b1d0d7-4555-4366-850f-5bc6592d515f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:51.900984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-28b1d0d7-4555-4366-850f-5bc6592d515f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:51.901926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-28b1d0d7-4555-4366-850f-5bc6592d515f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:51.902578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-28b1d0d7-4555-4366-850f-5bc6592d515f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:51.908237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9b8ab853-e339-43f0-91ac-abc88bbfa732 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:51.916849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9b8ab853-e339-43f0-91ac-abc88bbfa732 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.165729 May 24 13:01:51.917410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 148/304] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:51 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:52.051007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-28b1d0d7-4555-4366-850f-5bc6592d515f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:52.058812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-28b1d0d7-4555-4366-850f-5bc6592d515f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.169430 May 24 13:01:52.060083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 157/305] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:51 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:52.820152 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-07258136-2c27-4c89-935c-d112b3a71353 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:52.820752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-07258136-2c27-4c89-935c-d112b3a71353 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:52.827233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-07258136-2c27-4c89-935c-d112b3a71353 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:52.827674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-07258136-2c27-4c89-935c-d112b3a71353 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:52.828454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-07258136-2c27-4c89-935c-d112b3a71353 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:52.828886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-07258136-2c27-4c89-935c-d112b3a71353 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:52.933213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f0bd6b5e-6a94-4c4d-a67a-e9a4da749212 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:52.933818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f0bd6b5e-6a94-4c4d-a67a-e9a4da749212 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:52.940014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f0bd6b5e-6a94-4c4d-a67a-e9a4da749212 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:52.940466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f0bd6b5e-6a94-4c4d-a67a-e9a4da749212 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:52.941301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f0bd6b5e-6a94-4c4d-a67a-e9a4da749212 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:52.941957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f0bd6b5e-6a94-4c4d-a67a-e9a4da749212 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:52.971835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-07258136-2c27-4c89-935c-d112b3a71353 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:52.980028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-07258136-2c27-4c89-935c-d112b3a71353 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1553 microversion: 2.1 time: 0.164436 May 24 13:01:52.980593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 149/306] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:52 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:53.077267 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dda6813c-143f-4f89-bd69-0b14d341b7be tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:53.077988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dda6813c-143f-4f89-bd69-0b14d341b7be tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:53.084191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dda6813c-143f-4f89-bd69-0b14d341b7be tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:53.084725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dda6813c-143f-4f89-bd69-0b14d341b7be tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:53.085624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dda6813c-143f-4f89-bd69-0b14d341b7be tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:53.086148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dda6813c-143f-4f89-bd69-0b14d341b7be tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:53.147339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f0bd6b5e-6a94-4c4d-a67a-e9a4da749212 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:53.156192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f0bd6b5e-6a94-4c4d-a67a-e9a4da749212 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.226854 May 24 13:01:53.156975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 158/307] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:52 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:53.215533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dda6813c-143f-4f89-bd69-0b14d341b7be tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:53.223593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dda6813c-143f-4f89-bd69-0b14d341b7be tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.150918 May 24 13:01:53.224389 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 150/308] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:53 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:53.714214 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-0088b54b-83c2-446b-921b-22db66aa87be req-560b58c0-4d47-40fb-a2a3-39dffbd87c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47aefa9-f290-45b9-b10e-051bba4b7aa2", "tag": "5823fd96-0a74-4a99-a781-5fdd4ec37776"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:53.723288 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-0088b54b-83c2-446b-921b-22db66aa87be req-560b58c0-4d47-40fb-a2a3-39dffbd87c02 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:53.724013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-0088b54b-83c2-446b-921b-22db66aa87be req-560b58c0-4d47-40fb-a2a3-39dffbd87c02 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:53.736884 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-0088b54b-83c2-446b-921b-22db66aa87be req-560b58c0-4d47-40fb-a2a3-39dffbd87c02 service nova] Creating event network-changed:5823fd96-0a74-4a99-a781-5fdd4ec37776 for instance b47aefa9-f290-45b9-b10e-051bba4b7aa2 on hv-cinder-84301 May 24 13:01:53.741599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-0088b54b-83c2-446b-921b-22db66aa87be req-560b58c0-4d47-40fb-a2a3-39dffbd87c02 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031461 May 24 13:01:53.742078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 159/309] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:01:53.998122 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3f3b5a50-70f0-4caf-8c28-8473a322c096 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:53.998771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3f3b5a50-70f0-4caf-8c28-8473a322c096 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:54.005306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f3b5a50-70f0-4caf-8c28-8473a322c096 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:54.005749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f3b5a50-70f0-4caf-8c28-8473a322c096 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:54.006527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f3b5a50-70f0-4caf-8c28-8473a322c096 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:54.007035 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f3b5a50-70f0-4caf-8c28-8473a322c096 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:54.141615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3f3b5a50-70f0-4caf-8c28-8473a322c096 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:54.150276 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3f3b5a50-70f0-4caf-8c28-8473a322c096 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1553 microversion: 2.1 time: 0.156209 May 24 13:01:54.150881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 151/310] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:53 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:54.173257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9488c6eb-406c-4a73-ae85-b1655c6351a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:54.173990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9488c6eb-406c-4a73-ae85-b1655c6351a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:54.180754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9488c6eb-406c-4a73-ae85-b1655c6351a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:54.181201 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9488c6eb-406c-4a73-ae85-b1655c6351a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:54.181965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9488c6eb-406c-4a73-ae85-b1655c6351a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:54.182436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9488c6eb-406c-4a73-ae85-b1655c6351a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:54.240642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0223f274-ac8c-487e-83dc-ab2274fb64bb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:54.241777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0223f274-ac8c-487e-83dc-ab2274fb64bb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:54.248028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0223f274-ac8c-487e-83dc-ab2274fb64bb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:54.248468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0223f274-ac8c-487e-83dc-ab2274fb64bb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:54.249229 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0223f274-ac8c-487e-83dc-ab2274fb64bb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:54.249663 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0223f274-ac8c-487e-83dc-ab2274fb64bb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:54.321537 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9488c6eb-406c-4a73-ae85-b1655c6351a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:54.323953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:54.331137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9488c6eb-406c-4a73-ae85-b1655c6351a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.162045 May 24 13:01:54.331743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 160/311] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:54 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:54.380759 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0223f274-ac8c-487e-83dc-ab2274fb64bb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:54.388258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0223f274-ac8c-487e-83dc-ab2274fb64bb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.151568 May 24 13:01:54.388814 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 152/312] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:54 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:55.169166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-df7336a8-1b3d-4453-a358-cb91829808bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:55.169799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-df7336a8-1b3d-4453-a358-cb91829808bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:55.179374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-df7336a8-1b3d-4453-a358-cb91829808bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:55.179993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-df7336a8-1b3d-4453-a358-cb91829808bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:55.180593 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-df7336a8-1b3d-4453-a358-cb91829808bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:55.181039 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-df7336a8-1b3d-4453-a358-cb91829808bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:55.322048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-df7336a8-1b3d-4453-a358-cb91829808bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:55.330366 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-df7336a8-1b3d-4453-a358-cb91829808bd tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1553 microversion: 2.1 time: 0.167036 May 24 13:01:55.331099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 161/313] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:55 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:55.348073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-375c8360-c569-4119-b9a2-4619a004f2c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:55.348687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-375c8360-c569-4119-b9a2-4619a004f2c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:55.355968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-375c8360-c569-4119-b9a2-4619a004f2c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:55.356411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-375c8360-c569-4119-b9a2-4619a004f2c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:55.357177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-375c8360-c569-4119-b9a2-4619a004f2c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:55.357630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-375c8360-c569-4119-b9a2-4619a004f2c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:55.408419 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e7920971-1337-42bd-b78a-ffcf32914a14 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:55.408530 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e7920971-1337-42bd-b78a-ffcf32914a14 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:55.431129 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e7920971-1337-42bd-b78a-ffcf32914a14 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:55.431999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e7920971-1337-42bd-b78a-ffcf32914a14 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:55.433086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e7920971-1337-42bd-b78a-ffcf32914a14 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:55.433687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e7920971-1337-42bd-b78a-ffcf32914a14 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:55.544965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-375c8360-c569-4119-b9a2-4619a004f2c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:55.554595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-375c8360-c569-4119-b9a2-4619a004f2c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.210314 May 24 13:01:55.567909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 153/314] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:55 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:55.683985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e7920971-1337-42bd-b78a-ffcf32914a14 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:55.691491 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e7920971-1337-42bd-b78a-ffcf32914a14 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.289246 May 24 13:01:55.692053 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 162/315] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:55 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:56.348284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2941bb7c-c730-4401-ac74-aa232b5d2230 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:56.348885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2941bb7c-c730-4401-ac74-aa232b5d2230 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:56.355841 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2941bb7c-c730-4401-ac74-aa232b5d2230 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:56.356306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2941bb7c-c730-4401-ac74-aa232b5d2230 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:56.357057 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2941bb7c-c730-4401-ac74-aa232b5d2230 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:56.357492 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2941bb7c-c730-4401-ac74-aa232b5d2230 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:56.505234 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2941bb7c-c730-4401-ac74-aa232b5d2230 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:56.514132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2941bb7c-c730-4401-ac74-aa232b5d2230 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1553 microversion: 2.1 time: 0.169761 May 24 13:01:56.514924 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 154/316] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:56 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:56.573999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f5fbef0a-5f95-469e-9af3-5302cba786c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:56.580360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f5fbef0a-5f95-469e-9af3-5302cba786c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:56.589154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:56.591690 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f5fbef0a-5f95-469e-9af3-5302cba786c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:56.592563 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f5fbef0a-5f95-469e-9af3-5302cba786c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:56.594087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f5fbef0a-5f95-469e-9af3-5302cba786c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:56.594741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f5fbef0a-5f95-469e-9af3-5302cba786c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:56.712906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fcb99129-9d61-4836-a315-52114cae886f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:56.715198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fcb99129-9d61-4836-a315-52114cae886f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:56.727753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcb99129-9d61-4836-a315-52114cae886f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:56.731486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcb99129-9d61-4836-a315-52114cae886f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:56.732661 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcb99129-9d61-4836-a315-52114cae886f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:56.735957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcb99129-9d61-4836-a315-52114cae886f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:57.017712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f5fbef0a-5f95-469e-9af3-5302cba786c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:57.026780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f5fbef0a-5f95-469e-9af3-5302cba786c5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.457699 May 24 13:01:57.027745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 163/317] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:56 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:57.380331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fcb99129-9d61-4836-a315-52114cae886f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:57.396794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fcb99129-9d61-4836-a315-52114cae886f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.691409 May 24 13:01:57.397905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 155/318] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:56 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:01:57.535821 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-da5f52ff-86df-44d8-a5de-59b9f2a13471 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:57.536798 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-da5f52ff-86df-44d8-a5de-59b9f2a13471 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:57.551484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-da5f52ff-86df-44d8-a5de-59b9f2a13471 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:57.552213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-da5f52ff-86df-44d8-a5de-59b9f2a13471 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:57.553202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-da5f52ff-86df-44d8-a5de-59b9f2a13471 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:57.554149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-da5f52ff-86df-44d8-a5de-59b9f2a13471 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:57.749898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-da5f52ff-86df-44d8-a5de-59b9f2a13471 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:57.757904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-da5f52ff-86df-44d8-a5de-59b9f2a13471 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1553 microversion: 2.1 time: 0.228449 May 24 13:01:57.758495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 164/319] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:57 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:58.043499 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7972fb53-e0b1-4d95-a08a-92e4fd4a1563 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:58.044369 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7972fb53-e0b1-4d95-a08a-92e4fd4a1563 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:58.051191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7972fb53-e0b1-4d95-a08a-92e4fd4a1563 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:58.051631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7972fb53-e0b1-4d95-a08a-92e4fd4a1563 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:58.052702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7972fb53-e0b1-4d95-a08a-92e4fd4a1563 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:58.053342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7972fb53-e0b1-4d95-a08a-92e4fd4a1563 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:58.175339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-354ec9df-b84a-47f9-9d20-f5442ed2c0f6 req-396d38c6-ed3b-45b2-a640-030709d037a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f71a38-48c3-4411-98c8-00beab5f55b3", "name": "network-vif-deleted", "tag": "cf875030-2a08-4025-876f-dccb6cfa7b28"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:01:58.184870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-354ec9df-b84a-47f9-9d20-f5442ed2c0f6 req-396d38c6-ed3b-45b2-a640-030709d037a2 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:58.185548 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-354ec9df-b84a-47f9-9d20-f5442ed2c0f6 req-396d38c6-ed3b-45b2-a640-030709d037a2 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:58.200017 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-354ec9df-b84a-47f9-9d20-f5442ed2c0f6 req-396d38c6-ed3b-45b2-a640-030709d037a2 service nova] Creating event network-vif-deleted:cf875030-2a08-4025-876f-dccb6cfa7b28 for instance a5f71a38-48c3-4411-98c8-00beab5f55b3 on hv-cinder-84301 May 24 13:01:58.206808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-354ec9df-b84a-47f9-9d20-f5442ed2c0f6 req-396d38c6-ed3b-45b2-a640-030709d037a2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034962 May 24 13:01:58.207743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 165/320] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:01:58.344679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7972fb53-e0b1-4d95-a08a-92e4fd4a1563 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:58.355871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7972fb53-e0b1-4d95-a08a-92e4fd4a1563 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.315970 May 24 13:01:58.356534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 156/321] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:58 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:58.414369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cf5ce9bf-655c-4179-ba76-1a0bbae88b31 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:58.415099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cf5ce9bf-655c-4179-ba76-1a0bbae88b31 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:58.422012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf5ce9bf-655c-4179-ba76-1a0bbae88b31 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:58.422776 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf5ce9bf-655c-4179-ba76-1a0bbae88b31 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:58.423662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf5ce9bf-655c-4179-ba76-1a0bbae88b31 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:58.424193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf5ce9bf-655c-4179-ba76-1a0bbae88b31 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:58.584322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cf5ce9bf-655c-4179-ba76-1a0bbae88b31 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:58.591927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cf5ce9bf-655c-4179-ba76-1a0bbae88b31 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.182539 May 24 13:01:58.592495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 166/322] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:58 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:58.774941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-61196881-3bcb-42dc-9eda-06fc1b419f97 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:58.776302 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-61196881-3bcb-42dc-9eda-06fc1b419f97 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:58.782804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61196881-3bcb-42dc-9eda-06fc1b419f97 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:58.783251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61196881-3bcb-42dc-9eda-06fc1b419f97 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:58.784244 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61196881-3bcb-42dc-9eda-06fc1b419f97 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:58.784835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61196881-3bcb-42dc-9eda-06fc1b419f97 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:58.807368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:58.858403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-61196881-3bcb-42dc-9eda-06fc1b419f97 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:58.868874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-61196881-3bcb-42dc-9eda-06fc1b419f97 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1345 microversion: 2.1 time: 0.098726 May 24 13:01:58.869839 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 157/323] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:58 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:59.376119 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f2c1892d-d549-462f-bc34-10e2d3a34570 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:59.377841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f2c1892d-d549-462f-bc34-10e2d3a34570 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:59.394351 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f2c1892d-d549-462f-bc34-10e2d3a34570 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:59.395035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f2c1892d-d549-462f-bc34-10e2d3a34570 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:59.396092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f2c1892d-d549-462f-bc34-10e2d3a34570 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:59.396692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f2c1892d-d549-462f-bc34-10e2d3a34570 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:59.576178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f2c1892d-d549-462f-bc34-10e2d3a34570 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:59.585296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f2c1892d-d549-462f-bc34-10e2d3a34570 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.214764 May 24 13:01:59.586043 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 167/324] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:59 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:59.609199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-33c7fc6e-c166-41b2-a6a5-37ec47645113 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:59.609820 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-33c7fc6e-c166-41b2-a6a5-37ec47645113 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:59.616071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33c7fc6e-c166-41b2-a6a5-37ec47645113 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:59.616523 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33c7fc6e-c166-41b2-a6a5-37ec47645113 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:59.617320 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33c7fc6e-c166-41b2-a6a5-37ec47645113 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:59.617868 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33c7fc6e-c166-41b2-a6a5-37ec47645113 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:59.876208 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-33c7fc6e-c166-41b2-a6a5-37ec47645113 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:01:59.887853 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e6f6a669-c8ea-407b-b27f-94ab09529b29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:01:59.888656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e6f6a669-c8ea-407b-b27f-94ab09529b29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:01:59.890051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-33c7fc6e-c166-41b2-a6a5-37ec47645113 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.284709 May 24 13:01:59.891708 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 158/325] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:59 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:01:59.906796 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e6f6a669-c8ea-407b-b27f-94ab09529b29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:59.907246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e6f6a669-c8ea-407b-b27f-94ab09529b29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:59.908082 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e6f6a669-c8ea-407b-b27f-94ab09529b29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:01:59.908517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e6f6a669-c8ea-407b-b27f-94ab09529b29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:01:59.995206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e6f6a669-c8ea-407b-b27f-94ab09529b29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:00.004612 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e6f6a669-c8ea-407b-b27f-94ab09529b29 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1345 microversion: 2.1 time: 0.120940 May 24 13:02:00.005190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 168/326] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:01:59 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:00.603935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-98767feb-dc06-4d7d-8a26-bd7daa95f17d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:00.604572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-98767feb-dc06-4d7d-8a26-bd7daa95f17d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:00.611500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98767feb-dc06-4d7d-8a26-bd7daa95f17d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:00.611944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98767feb-dc06-4d7d-8a26-bd7daa95f17d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:00.612701 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98767feb-dc06-4d7d-8a26-bd7daa95f17d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:00.613294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98767feb-dc06-4d7d-8a26-bd7daa95f17d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:00.756765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-98767feb-dc06-4d7d-8a26-bd7daa95f17d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:00.770454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-98767feb-dc06-4d7d-8a26-bd7daa95f17d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.171017 May 24 13:02:00.771129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 159/327] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:00 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:00.909107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4caf491a-7a25-403a-8fe6-6d88a705b2eb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:00.909650 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4caf491a-7a25-403a-8fe6-6d88a705b2eb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:00.916831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4caf491a-7a25-403a-8fe6-6d88a705b2eb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:00.917585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4caf491a-7a25-403a-8fe6-6d88a705b2eb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:00.918756 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4caf491a-7a25-403a-8fe6-6d88a705b2eb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:00.919349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4caf491a-7a25-403a-8fe6-6d88a705b2eb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:01.021075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-21beec4b-f36c-4c33-aef4-bfa716ba3828 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:01.022938 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-21beec4b-f36c-4c33-aef4-bfa716ba3828 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:01.030233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21beec4b-f36c-4c33-aef4-bfa716ba3828 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:01.030930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21beec4b-f36c-4c33-aef4-bfa716ba3828 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:01.031888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21beec4b-f36c-4c33-aef4-bfa716ba3828 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:01.033038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21beec4b-f36c-4c33-aef4-bfa716ba3828 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:01.076398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-4caf491a-7a25-403a-8fe6-6d88a705b2eb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:01.088941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4caf491a-7a25-403a-8fe6-6d88a705b2eb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.183769 May 24 13:02:01.089846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 169/328] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:00 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:01.116956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-21beec4b-f36c-4c33-aef4-bfa716ba3828 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39adb89399764ce0af29ceea422f8fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc76452e79c4411b4592c239245cf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:01.130700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-21beec4b-f36c-4c33-aef4-bfa716ba3828 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 200 len: 1345 microversion: 2.1 time: 0.113531 May 24 13:02:01.140697 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 160/329] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:01 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 1345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:01.789821 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a4115bc4-b271-414c-86d8-66b795ce46bd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:01.790471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a4115bc4-b271-414c-86d8-66b795ce46bd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:01.805803 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a4115bc4-b271-414c-86d8-66b795ce46bd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:01.806539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a4115bc4-b271-414c-86d8-66b795ce46bd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:01.807747 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a4115bc4-b271-414c-86d8-66b795ce46bd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:01.808421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a4115bc4-b271-414c-86d8-66b795ce46bd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:02.007026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a4115bc4-b271-414c-86d8-66b795ce46bd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:02.013686 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a4115bc4-b271-414c-86d8-66b795ce46bd tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.228118 May 24 13:02:02.016997 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 170/330] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:01 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:02.107004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e13e39db-8436-4a7f-9475-252db393240f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:02.107618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e13e39db-8436-4a7f-9475-252db393240f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:02.115351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e13e39db-8436-4a7f-9475-252db393240f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:02.116382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e13e39db-8436-4a7f-9475-252db393240f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:02.117808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e13e39db-8436-4a7f-9475-252db393240f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:02.118391 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e13e39db-8436-4a7f-9475-252db393240f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:02.149700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:02.150637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:02.171002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:02.171461 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:02.172247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:02.173286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:02.190430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] HTTP exception thrown: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Request method failure captured: May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 HTTP/1.1 May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbMKMRksymPoM1pK2S6DEe7Og7YGs-Nx93GZ5lfEz0Sc0ow2GBXmo9u7sMbPLSJ6fM0QzUMmfv4f7-v5TjKfxMPYbacJnYgJATwEjJ8wrtlX_V4l9Lmis9F17xEg4v3kZ35ZN0PFO1X6ewFYBQcoa1GXcOjpKzoVgpQLbx454GnPvE May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: cbc76452e79c4411b4592c239245cf5d May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-DeleteServersTestJSON-32110806 May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:02:02.198364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-DeleteServersTestJSON-32110806 May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: cbc76452e79c4411b4592c239245cf5d May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-DeleteServersTestJSON-32110806 May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-DeleteServersTestJSON-32110806-project May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 39adb89399764ce0af29ceea422f8fe5 May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-DeleteServersTestJSON-32110806-project May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.200163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': 'a5f71a38-48c3-4411-98c8-00beab5f55b3'} May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:02.201140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.202835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.204246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Returning 404 to user: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:02.204246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-42565f62-f5d3-45ba-882a-f81e728c0b0a tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 404 len: 111 microversion: 2.1 time: 0.055754 May 24 13:02:02.204246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 171/331] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:02 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:02:02.313587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e13e39db-8436-4a7f-9475-252db393240f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:02.327872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e13e39db-8436-4a7f-9475-252db393240f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.224659 May 24 13:02:02.329242 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 161/332] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:02 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:02.330071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:02.331123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:02.345229 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:02.345752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:02.346530 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:02.346977 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:02.361562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] HTTP exception thrown: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Request method failure captured: May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3/os-volume_attachments HTTP/1.1 May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbMKMRksymPoM1pK2S6DEe7Og7YGs-Nx93GZ5lfEz0Sc0ow2GBXmo9u7sMbPLSJ6fM0QzUMmfv4f7-v5TjKfxMPYbacJnYgJATwEjJ8wrtlX_V4l9Lmis9F17xEg4v3kZ35ZN0PFO1X6ewFYBQcoa1GXcOjpKzoVgpQLbx454GnPvE May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: cbc76452e79c4411b4592c239245cf5d May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-DeleteServersTestJSON-32110806 May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:02:02.369569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-DeleteServersTestJSON-32110806 May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: cbc76452e79c4411b4592c239245cf5d May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-DeleteServersTestJSON-32110806 May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-DeleteServersTestJSON-32110806-project May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 39adb89399764ce0af29ceea422f8fe5 May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-DeleteServersTestJSON-32110806-project May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.371375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'server_id': 'a5f71a38-48c3-4411-98c8-00beab5f55b3'} May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:02.372810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:02.374708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:02.376115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Returning 404 to user: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:02.376115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fc74890e-4fb9-44b2-9ace-4585dc110931 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046546 May 24 13:02:02.376115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 172/333] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:02:02 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:02:03.035363 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b3d03df1-c1d7-468e-af05-85e5b2cb049c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:03.036352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b3d03df1-c1d7-468e-af05-85e5b2cb049c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:03.052312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b3d03df1-c1d7-468e-af05-85e5b2cb049c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:03.052770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b3d03df1-c1d7-468e-af05-85e5b2cb049c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:03.055660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b3d03df1-c1d7-468e-af05-85e5b2cb049c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:03.056034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b3d03df1-c1d7-468e-af05-85e5b2cb049c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:03.221894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b3d03df1-c1d7-468e-af05-85e5b2cb049c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:03.230913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b3d03df1-c1d7-468e-af05-85e5b2cb049c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.200263 May 24 13:02:03.231477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 162/334] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:03 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:03.351041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ff236080-3bff-4a8b-bb03-44766c91005d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:03.352180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ff236080-3bff-4a8b-bb03-44766c91005d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:03.360102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ff236080-3bff-4a8b-bb03-44766c91005d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:03.360593 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ff236080-3bff-4a8b-bb03-44766c91005d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:03.361672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ff236080-3bff-4a8b-bb03-44766c91005d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:03.362382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ff236080-3bff-4a8b-bb03-44766c91005d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:03.574330 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ff236080-3bff-4a8b-bb03-44766c91005d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:03.582131 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ff236080-3bff-4a8b-bb03-44766c91005d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.239767 May 24 13:02:03.582768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 173/335] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:03 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:03.639030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:03.640535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:03.651052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:03.651927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:03.653065 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:03.653720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:03.673328 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] HTTP exception thrown: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Request method failure captured: May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 HTTP/1.1 May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNbMKMRksymPoM1pK2S6DEe7Og7YGs-Nx93GZ5lfEz0Sc0ow2GBXmo9u7sMbPLSJ6fM0QzUMmfv4f7-v5TjKfxMPYbacJnYgJATwEjJ8wrtlX_V4l9Lmis9F17xEg4v3kZ35ZN0PFO1X6ewFYBQcoa1GXcOjpKzoVgpQLbx454GnPvE May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: cbc76452e79c4411b4592c239245cf5d May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-DeleteServersTestJSON-32110806 May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:02:03.678404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-DeleteServersTestJSON-32110806 May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cbc76452e79c4411b4592c239245cf5d May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-DeleteServersTestJSON-32110806 May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-DeleteServersTestJSON-32110806-project May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 39adb89399764ce0af29ceea422f8fe5 May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-DeleteServersTestJSON-32110806-project May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.680037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'a5f71a38-48c3-4411-98c8-00beab5f55b3'} May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:03.680796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.682161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:03.684526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Returning 404 to user: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:03.685530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dd71cd4f-ee26-47eb-b93d-5e1c8c258043 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 404 len: 111 microversion: 2.1 time: 0.053831 May 24 13:02:03.686376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 163/336] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:02:03 2022] DELETE /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:02:03.695245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:03.696051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] [instance: a5f71a38-48c3-4411-98c8-00beab5f55b3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:03.703057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:03.703636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:03.704522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:03.705543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:03.722769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] HTTP exception thrown: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Request method failure captured: May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 HTTP/1.1 May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbMKMRksymPoM1pK2S6DEe7Og7YGs-Nx93GZ5lfEz0Sc0ow2GBXmo9u7sMbPLSJ6fM0QzUMmfv4f7-v5TjKfxMPYbacJnYgJATwEjJ8wrtlX_V4l9Lmis9F17xEg4v3kZ35ZN0PFO1X6ewFYBQcoa1GXcOjpKzoVgpQLbx454GnPvE May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: cbc76452e79c4411b4592c239245cf5d May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-DeleteServersTestJSON-32110806 May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:02:03.724319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbc76452e79c4411b4592c239245cf5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-DeleteServersTestJSON-32110806 May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: cbc76452e79c4411b4592c239245cf5d May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-DeleteServersTestJSON-32110806 May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-DeleteServersTestJSON-32110806-project May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 39adb89399764ce0af29ceea422f8fe5 May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-DeleteServersTestJSON-32110806-project May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.726316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': 'a5f71a38-48c3-4411-98c8-00beab5f55b3'} May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:03.727183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. May 24 13:02:03.728295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:03.729228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] Returning 404 to user: Instance a5f71a38-48c3-4411-98c8-00beab5f55b3 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:03.729228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a5d8b71a-0899-4ac2-958b-6b8003f2db65 tempest-DeleteServersTestJSON-32110806 tempest-DeleteServersTestJSON-32110806-project] 10.222.0.45 "GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3" status: 404 len: 111 microversion: 2.1 time: 0.035864 May 24 13:02:03.729228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 174/337] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:03 2022] GET /compute/v2.1/servers/a5f71a38-48c3-4411-98c8-00beab5f55b3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:02:04.248572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9393ed02-74d0-46cd-a1c8-438999ee4075 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:04.258611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9393ed02-74d0-46cd-a1c8-438999ee4075 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:04.263384 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9393ed02-74d0-46cd-a1c8-438999ee4075 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:04.264206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9393ed02-74d0-46cd-a1c8-438999ee4075 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:04.264863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9393ed02-74d0-46cd-a1c8-438999ee4075 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:04.265496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9393ed02-74d0-46cd-a1c8-438999ee4075 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:04.410573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9393ed02-74d0-46cd-a1c8-438999ee4075 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:04.418908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9393ed02-74d0-46cd-a1c8-438999ee4075 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.174438 May 24 13:02:04.420879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 164/338] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:04 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:04.599533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-23b98ca8-d9d0-48e2-a155-cfd15ebf088f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:04.600869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-23b98ca8-d9d0-48e2-a155-cfd15ebf088f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:04.611518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-23b98ca8-d9d0-48e2-a155-cfd15ebf088f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:04.612071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-23b98ca8-d9d0-48e2-a155-cfd15ebf088f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:04.612919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-23b98ca8-d9d0-48e2-a155-cfd15ebf088f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:04.613376 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-23b98ca8-d9d0-48e2-a155-cfd15ebf088f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:04.754171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-23b98ca8-d9d0-48e2-a155-cfd15ebf088f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:04.762549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-23b98ca8-d9d0-48e2-a155-cfd15ebf088f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.166973 May 24 13:02:04.763228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 175/339] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:04 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:05.048331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-250d8e09-65fd-4ccd-8ec8-84aad4d053bf req-3ed993fa-f823-4481-b931-3809f4f453b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47aefa9-f290-45b9-b10e-051bba4b7aa2", "name": "network-vif-plugged", "status": "completed", "tag": "5823fd96-0a74-4a99-a781-5fdd4ec37776"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:02:05.060136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-250d8e09-65fd-4ccd-8ec8-84aad4d053bf req-3ed993fa-f823-4481-b931-3809f4f453b8 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:05.060136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-250d8e09-65fd-4ccd-8ec8-84aad4d053bf req-3ed993fa-f823-4481-b931-3809f4f453b8 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:05.082799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-250d8e09-65fd-4ccd-8ec8-84aad4d053bf req-3ed993fa-f823-4481-b931-3809f4f453b8 service nova] Creating event network-vif-plugged:5823fd96-0a74-4a99-a781-5fdd4ec37776 for instance b47aefa9-f290-45b9-b10e-051bba4b7aa2 on hv-cinder-84301 May 24 13:02:05.088570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-250d8e09-65fd-4ccd-8ec8-84aad4d053bf req-3ed993fa-f823-4481-b931-3809f4f453b8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043695 May 24 13:02:05.089157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 165/340] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:02:05.437595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-00d64845-21f4-45f0-9370-b3cda2beb252 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:05.438416 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-00d64845-21f4-45f0-9370-b3cda2beb252 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:05.444426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-00d64845-21f4-45f0-9370-b3cda2beb252 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:05.444871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-00d64845-21f4-45f0-9370-b3cda2beb252 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:05.448542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-00d64845-21f4-45f0-9370-b3cda2beb252 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:05.448542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-00d64845-21f4-45f0-9370-b3cda2beb252 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:05.586662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-00d64845-21f4-45f0-9370-b3cda2beb252 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:05.595162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-00d64845-21f4-45f0-9370-b3cda2beb252 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.162150 May 24 13:02:05.595834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 176/341] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:05 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:05.781464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-076d1f80-820c-4e57-88e9-379381acf0ba tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:05.782206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-076d1f80-820c-4e57-88e9-379381acf0ba tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:05.789837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-076d1f80-820c-4e57-88e9-379381acf0ba tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:05.790581 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-076d1f80-820c-4e57-88e9-379381acf0ba tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:05.791394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-076d1f80-820c-4e57-88e9-379381acf0ba tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:05.791824 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-076d1f80-820c-4e57-88e9-379381acf0ba tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:05.936090 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-076d1f80-820c-4e57-88e9-379381acf0ba tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:05.943559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-076d1f80-820c-4e57-88e9-379381acf0ba tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.167711 May 24 13:02:05.944179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 166/342] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:05 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:05.984937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a9a94e96-c388-4ac2-b47e-b4a0c290253a tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Action: 'create', calling method: .version_select at 0x7f9a66081e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-559135630", "metadata": {"Type": "work"}}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a9a94e96-c388-4ac2-b47e-b4a0c290253a tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Request method failure captured: May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 121 May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNdNxFUnjqQ0aTYZK-nFchlfNN1gCblAuZDYoOsz7swY4OA8XJCVXs7Jl1MNOi0zqt7m_QQ_IIU_p_2GnlixAR390tA1Nk0TQiWCjtjeI-78z8r3hGtom55bfZOyA4CIwOcbpSIBNFYBdC9tPH3CB9C_P54OYflKiwZTWr6Bk8tZq8c May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 817a68111f89402891773dea17391e94 May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:02:05.996660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/817a68111f89402891773dea17391e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_817a68111f89402891773dea17391e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-VolumesNegativeTest-1945354008 May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 817a68111f89402891773dea17391e94 May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 7cae739c8fa74c058b5e9849ef30dca5 May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-559135630", "metadata": {"Type": "work"}}} May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: May 24 13:02:05.998098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-559135630', 'metadata': {'Type': 'work'}}}} May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise error May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi '#$%' May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:05.999048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 13:02:06.000383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 13:02:06.001444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 13:02:06.001444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.001444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a9a94e96-c388-4ac2-b47e-b4a0c290253a tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:06.001444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a9a94e96-c388-4ac2-b47e-b4a0c290253a tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.169377 May 24 13:02:06.001444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 177/343] 10.222.0.45 () {60 vars in 1155 bytes} [Tue May 24 13:02:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 24 13:02:06.008333 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7660e128-c97a-4c72-85d9-70d502300927 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Action: 'create', calling method: .version_select at 0x7f9a6736b820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2139792383", "metadata": {"Type": "work"}}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7660e128-c97a-4c72-85d9-70d502300927 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Request method failure captured: May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 120 May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNdNxFUnjqQ0aTYZK-nFchlfNN1gCblAuZDYoOsz7swY4OA8XJCVXs7Jl1MNOi0zqt7m_QQ_IIU_p_2GnlixAR390tA1Nk0TQiWCjtjeI-78z8r3hGtom55bfZOyA4CIwOcbpSIBNFYBdC9tPH3CB9C_P54OYflKiwZTWr6Bk8tZq8c May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:02:06.011931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/817a68111f89402891773dea17391e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_817a68111f89402891773dea17391e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 7cae739c8fa74c058b5e9849ef30dca5 May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2139792383", "metadata": {"Type": "work"}}} May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: May 24 13:02:06.013419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2139792383', 'metadata': {'Type': 'work'}}}} May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise error May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi '0' May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:06.014622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 13:02:06.016112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 13:02:06.017398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 13:02:06.017398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.017398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7660e128-c97a-4c72-85d9-70d502300927 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:06.017398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7660e128-c97a-4c72-85d9-70d502300927 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008937 May 24 13:02:06.017398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 167/344] 10.222.0.45 () {60 vars in 1155 bytes} [Tue May 24 13:02:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 24 13:02:06.023260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5b030c74-ffe8-4c59-a5c1-e5748b33e19e tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Action: 'create', calling method: .version_select at 0x7f9a6609d820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1668514455", "metadata": {"Type": "work"}}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5b030c74-ffe8-4c59-a5c1-e5748b33e19e tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Request method failure captured: May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 119 May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNdNxFUnjqQ0aTYZK-nFchlfNN1gCblAuZDYoOsz7swY4OA8XJCVXs7Jl1MNOi0zqt7m_QQ_IIU_p_2GnlixAR390tA1Nk0TQiWCjtjeI-78z8r3hGtom55bfZOyA4CIwOcbpSIBNFYBdC9tPH3CB9C_P54OYflKiwZTWr6Bk8tZq8c May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:02:06.025552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/817a68111f89402891773dea17391e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_817a68111f89402891773dea17391e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 7cae739c8fa74c058b5e9849ef30dca5 May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1668514455", "metadata": {"Type": "work"}}} May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: May 24 13:02:06.026992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1668514455', 'metadata': {'Type': 'work'}}}} May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise error May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi '' May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:06.027881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 13:02:06.029400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 13:02:06.031009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 13:02:06.031009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.031009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5b030c74-ffe8-4c59-a5c1-e5748b33e19e tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:06.031009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5b030c74-ffe8-4c59-a5c1-e5748b33e19e tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007939 May 24 13:02:06.031009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 178/345] 10.222.0.45 () {60 vars in 1155 bytes} [Tue May 24 13:02:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 13:02:06.037114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7b266f8b-74d9-4c10-b481-97fe8b364f18 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Calling method '.version_select at 0x7f9a6707e8b0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:06.066457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-7b266f8b-74d9-4c10-b481-97fe8b364f18 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] HTTP exception thrown: Volume tempest-invalid-762256870 could not be found. May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7b266f8b-74d9-4c10-b481-97fe8b364f18 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Request method failure captured: May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-762256870 HTTP/1.1 May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNdNxFUnjqQ0aTYZK-nFchlfNN1gCblAuZDYoOsz7swY4OA8XJCVXs7Jl1MNOi0zqt7m_QQ_IIU_p_2GnlixAR390tA1Nk0TQiWCjtjeI-78z8r3hGtom55bfZOyA4CIwOcbpSIBNFYBdC9tPH3CB9C_P54OYflKiwZTWr6Bk8tZq8c May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:02:06.068612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/817a68111f89402891773dea17391e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_817a68111f89402891773dea17391e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 7cae739c8fa74c058b5e9849ef30dca5 May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Volume tempest-invalid-762256870 could not be found. May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'tempest-invalid-762256870'} May 24 13:02:06.070299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-762256870 could not be found. (HTTP 404) (Request-ID: req-b558459d-dff0-48d5-a255-4f1ac2f2ef68) May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.071012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:02:06.072222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-762256870 could not be found. May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:02:06.073528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-762256870 could not be found. May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-762256870 could not be found. May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7b266f8b-74d9-4c10-b481-97fe8b364f18 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Returning 404 to user: Volume tempest-invalid-762256870 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7b266f8b-74d9-4c10-b481-97fe8b364f18 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-762256870" status: 404 len: 98 microversion: 2.1 time: 0.037218 May 24 13:02:06.075508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 168/346] 10.222.0.45 () {58 vars in 1214 bytes} [Tue May 24 13:02:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-762256870 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 24 13:02:06.081862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-10672939-aefc-4a59-915a-14ab999ab45f tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004769 May 24 13:02:06.082452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 179/347] 10.222.0.45 () {58 vars in 1139 bytes} [Tue May 24 13:02:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 24 13:02:06.091919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1852827d-daf7-4b33-880d-7e8ee79c8c84 tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003876 May 24 13:02:06.092384 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 169/348] 10.222.0.45 () {58 vars in 1136 bytes} [Tue May 24 13:02:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 24 13:02:06.100986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4144d891-8a2a-4857-90f0-4b37259285ab tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Calling method '.version_select at 0x7f9a66081d30>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:06.130191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-4144d891-8a2a-4857-90f0-4b37259285ab tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] HTTP exception thrown: Volume 9d7152ee-2c10-4516-aac6-c652074647c8 could not be found. May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4144d891-8a2a-4857-90f0-4b37259285ab tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Request method failure captured: May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: DELETE /compute/v2.1/os-volumes/9d7152ee-2c10-4516-aac6-c652074647c8 HTTP/1.1 May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNdNxFUnjqQ0aTYZK-nFchlfNN1gCblAuZDYoOsz7swY4OA8XJCVXs7Jl1MNOi0zqt7m_QQ_IIU_p_2GnlixAR390tA1Nk0TQiWCjtjeI-78z8r3hGtom55bfZOyA4CIwOcbpSIBNFYBdC9tPH3CB9C_P54OYflKiwZTWr6Bk8tZq8c May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:02:06.134307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/817a68111f89402891773dea17391e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_817a68111f89402891773dea17391e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 7cae739c8fa74c058b5e9849ef30dca5 May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Volume 9d7152ee-2c10-4516-aac6-c652074647c8 could not be found. May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '9d7152ee-2c10-4516-aac6-c652074647c8'} May 24 13:02:06.135757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d7152ee-2c10-4516-aac6-c652074647c8 could not be found. (HTTP 404) (Request-ID: req-5a72e117-c135-4c1a-a0b5-d218462be78b) May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.136482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:02:06.137581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d7152ee-2c10-4516-aac6-c652074647c8 could not be found. May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 13:02:06.138938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d7152ee-2c10-4516-aac6-c652074647c8 could not be found. May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d7152ee-2c10-4516-aac6-c652074647c8 could not be found. May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4144d891-8a2a-4857-90f0-4b37259285ab tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Returning 404 to user: Volume 9d7152ee-2c10-4516-aac6-c652074647c8 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4144d891-8a2a-4857-90f0-4b37259285ab tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/9d7152ee-2c10-4516-aac6-c652074647c8" status: 404 len: 109 microversion: 2.1 time: 0.038602 May 24 13:02:06.140142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 180/349] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 13:02:06 2022] DELETE /compute/v2.1/os-volumes/9d7152ee-2c10-4516-aac6-c652074647c8 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:02:06.146413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4d145353-2086-4e54-8664-48058d1fd34d tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Calling method '.version_select at 0x7f9a670f40d0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:06.176502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-4d145353-2086-4e54-8664-48058d1fd34d tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] HTTP exception thrown: Volume 62bb44b2-3297-4340-ac09-5d2833804052 could not be found. May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4d145353-2086-4e54-8664-48058d1fd34d tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Request method failure captured: May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/os-volumes/62bb44b2-3297-4340-ac09-5d2833804052 HTTP/1.1 May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNdNxFUnjqQ0aTYZK-nFchlfNN1gCblAuZDYoOsz7swY4OA8XJCVXs7Jl1MNOi0zqt7m_QQ_IIU_p_2GnlixAR390tA1Nk0TQiWCjtjeI-78z8r3hGtom55bfZOyA4CIwOcbpSIBNFYBdC9tPH3CB9C_P54OYflKiwZTWr6Bk8tZq8c May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:02:06.178516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/817a68111f89402891773dea17391e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_817a68111f89402891773dea17391e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/817a68111f89402891773dea17391e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 817a68111f89402891773dea17391e94 May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesNegativeTest-1945354008 May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 7cae739c8fa74c058b5e9849ef30dca5 May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesNegativeTest-1945354008-project May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Volume 62bb44b2-3297-4340-ac09-5d2833804052 could not be found. May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '62bb44b2-3297-4340-ac09-5d2833804052'} May 24 13:02:06.179917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 62bb44b2-3297-4340-ac09-5d2833804052 could not be found. (HTTP 404) (Request-ID: req-da5591aa-9a0d-4daa-937a-f59fc9d161c6) May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.180797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:02:06.182118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 62bb44b2-3297-4340-ac09-5d2833804052 could not be found. May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 13:02:06.183465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 62bb44b2-3297-4340-ac09-5d2833804052 could not be found. May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 62bb44b2-3297-4340-ac09-5d2833804052 could not be found. May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4d145353-2086-4e54-8664-48058d1fd34d tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] Returning 404 to user: Volume 62bb44b2-3297-4340-ac09-5d2833804052 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4d145353-2086-4e54-8664-48058d1fd34d tempest-VolumesNegativeTest-1945354008 tempest-VolumesNegativeTest-1945354008-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/62bb44b2-3297-4340-ac09-5d2833804052" status: 404 len: 109 microversion: 2.1 time: 0.037586 May 24 13:02:06.184778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 170/350] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:02:06 2022] GET /compute/v2.1/os-volumes/62bb44b2-3297-4340-ac09-5d2833804052 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:02:06.613911 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c04ac3b6-8bcf-4930-ba57-ac184ac9fbb5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:06.615031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c04ac3b6-8bcf-4930-ba57-ac184ac9fbb5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:06.623686 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c04ac3b6-8bcf-4930-ba57-ac184ac9fbb5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:06.624143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c04ac3b6-8bcf-4930-ba57-ac184ac9fbb5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:06.625105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c04ac3b6-8bcf-4930-ba57-ac184ac9fbb5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:06.625996 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c04ac3b6-8bcf-4930-ba57-ac184ac9fbb5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:06.835197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c04ac3b6-8bcf-4930-ba57-ac184ac9fbb5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:06.848102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c04ac3b6-8bcf-4930-ba57-ac184ac9fbb5 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1313 microversion: 2.1 time: 0.238649 May 24 13:02:06.849554 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 181/351] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:06 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:06.962326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cb1fcbf4-4c57-4702-aed5-ad4b45b38652 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:06.963178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cb1fcbf4-4c57-4702-aed5-ad4b45b38652 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:06.969743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb1fcbf4-4c57-4702-aed5-ad4b45b38652 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:06.970200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb1fcbf4-4c57-4702-aed5-ad4b45b38652 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:06.971017 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb1fcbf4-4c57-4702-aed5-ad4b45b38652 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:06.971459 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb1fcbf4-4c57-4702-aed5-ad4b45b38652 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:07.182736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cb1fcbf4-4c57-4702-aed5-ad4b45b38652 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:07.191694 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cb1fcbf4-4c57-4702-aed5-ad4b45b38652 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.235358 May 24 13:02:07.193388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 171/352] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:06 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:07.867548 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-454c6a61-c4f8-4138-9675-2ba572b87b48 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:07.869177 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-454c6a61-c4f8-4138-9675-2ba572b87b48 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:07.876873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-454c6a61-c4f8-4138-9675-2ba572b87b48 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:07.877526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-454c6a61-c4f8-4138-9675-2ba572b87b48 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:07.878852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-454c6a61-c4f8-4138-9675-2ba572b87b48 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:07.882758 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-454c6a61-c4f8-4138-9675-2ba572b87b48 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:08.111959 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-454c6a61-c4f8-4138-9675-2ba572b87b48 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:08.122874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-454c6a61-c4f8-4138-9675-2ba572b87b48 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1497 microversion: 2.1 time: 0.260168 May 24 13:02:08.123778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 182/353] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:07 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:08.211254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fa53c730-a847-4d02-8dc4-753a0aa8c70a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:08.211922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fa53c730-a847-4d02-8dc4-753a0aa8c70a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:08.222831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fa53c730-a847-4d02-8dc4-753a0aa8c70a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:08.223282 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fa53c730-a847-4d02-8dc4-753a0aa8c70a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:08.224061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fa53c730-a847-4d02-8dc4-753a0aa8c70a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:08.224497 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fa53c730-a847-4d02-8dc4-753a0aa8c70a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:08.398684 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fa53c730-a847-4d02-8dc4-753a0aa8c70a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:08.409221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fa53c730-a847-4d02-8dc4-753a0aa8c70a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.202870 May 24 13:02:08.409221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 172/354] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:08 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:08.712922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8dd3a4ae-270b-453c-9c7b-dab5ef9d81a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:08.713646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8dd3a4ae-270b-453c-9c7b-dab5ef9d81a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:08.721317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dd3a4ae-270b-453c-9c7b-dab5ef9d81a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:08.722152 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dd3a4ae-270b-453c-9c7b-dab5ef9d81a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:08.722983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dd3a4ae-270b-453c-9c7b-dab5ef9d81a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:08.723582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dd3a4ae-270b-453c-9c7b-dab5ef9d81a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:08.753077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8dd3a4ae-270b-453c-9c7b-dab5ef9d81a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Going to try to terminate instance {{(pid=117643) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:02:08.774145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:08.889745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8dd3a4ae-270b-453c-9c7b-dab5ef9d81a9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 204 len: 0 microversion: 2.1 time: 0.183567 May 24 13:02:08.891111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 183/355] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:02:08 2022] DELETE /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 13:02:08.899687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d6ebd4a1-cb2f-4ba3-96e9-38495864ecea tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:08.900297 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d6ebd4a1-cb2f-4ba3-96e9-38495864ecea tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:08.910192 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6ebd4a1-cb2f-4ba3-96e9-38495864ecea tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:08.910852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6ebd4a1-cb2f-4ba3-96e9-38495864ecea tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:08.911881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6ebd4a1-cb2f-4ba3-96e9-38495864ecea tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:08.912666 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6ebd4a1-cb2f-4ba3-96e9-38495864ecea tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:09.083368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d6ebd4a1-cb2f-4ba3-96e9-38495864ecea tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:09.091457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d6ebd4a1-cb2f-4ba3-96e9-38495864ecea tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1503 microversion: 2.1 time: 0.195786 May 24 13:02:09.092087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 173/356] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:08 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:09.425337 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3a2a470f-540e-4464-a725-42c0d63f17f0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:09.426051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3a2a470f-540e-4464-a725-42c0d63f17f0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:09.435452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3a2a470f-540e-4464-a725-42c0d63f17f0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:09.435902 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3a2a470f-540e-4464-a725-42c0d63f17f0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:09.436682 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3a2a470f-540e-4464-a725-42c0d63f17f0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:09.437125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3a2a470f-540e-4464-a725-42c0d63f17f0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:09.582036 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3a2a470f-540e-4464-a725-42c0d63f17f0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:09.591172 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3a2a470f-540e-4464-a725-42c0d63f17f0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.170036 May 24 13:02:09.591850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 184/357] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:09 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:10.109814 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-50faf701-eaa7-4387-88ca-211c03cc1b70 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:10.110567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-50faf701-eaa7-4387-88ca-211c03cc1b70 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:10.117500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50faf701-eaa7-4387-88ca-211c03cc1b70 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:10.118131 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50faf701-eaa7-4387-88ca-211c03cc1b70 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:10.118965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50faf701-eaa7-4387-88ca-211c03cc1b70 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:10.119478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50faf701-eaa7-4387-88ca-211c03cc1b70 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:10.265127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-50faf701-eaa7-4387-88ca-211c03cc1b70 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:10.274433 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-50faf701-eaa7-4387-88ca-211c03cc1b70 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1503 microversion: 2.1 time: 0.168449 May 24 13:02:10.275024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 174/358] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:10 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:10.607940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2a370343-9acc-4b73-90d8-298ec36f2db3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:10.608558 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2a370343-9acc-4b73-90d8-298ec36f2db3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:10.614651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2a370343-9acc-4b73-90d8-298ec36f2db3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:10.615106 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2a370343-9acc-4b73-90d8-298ec36f2db3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:10.616440 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2a370343-9acc-4b73-90d8-298ec36f2db3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:10.616885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2a370343-9acc-4b73-90d8-298ec36f2db3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:10.750347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2a370343-9acc-4b73-90d8-298ec36f2db3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:10.759089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2a370343-9acc-4b73-90d8-298ec36f2db3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.155149 May 24 13:02:10.759662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 185/359] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:10 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:11.292776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca380ce3-3449-400b-87bf-15a0cd009d33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:11.294027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ca380ce3-3449-400b-87bf-15a0cd009d33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:11.301342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca380ce3-3449-400b-87bf-15a0cd009d33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:11.301790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca380ce3-3449-400b-87bf-15a0cd009d33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:11.302580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca380ce3-3449-400b-87bf-15a0cd009d33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:11.303711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca380ce3-3449-400b-87bf-15a0cd009d33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:11.537138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ca380ce3-3449-400b-87bf-15a0cd009d33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:11.556989 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ca380ce3-3449-400b-87bf-15a0cd009d33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 200 len: 1503 microversion: 2.1 time: 0.268719 May 24 13:02:11.562791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 175/360] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:11 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:11.759035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-b797f71f-56ce-4928-9661-9b15dc540c5e req-7b76d6c4-953f-441f-815d-b9f68ffb3fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47aefa9-f290-45b9-b10e-051bba4b7aa2", "name": "network-vif-deleted", "tag": "5823fd96-0a74-4a99-a781-5fdd4ec37776"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:02:11.771004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-b797f71f-56ce-4928-9661-9b15dc540c5e req-7b76d6c4-953f-441f-815d-b9f68ffb3fe1 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:11.772320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-b797f71f-56ce-4928-9661-9b15dc540c5e req-7b76d6c4-953f-441f-815d-b9f68ffb3fe1 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:11.776467 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-46944436-8359-4fb9-a105-81df6bb9297e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:11.777140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-46944436-8359-4fb9-a105-81df6bb9297e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:11.786658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46944436-8359-4fb9-a105-81df6bb9297e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:11.787374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46944436-8359-4fb9-a105-81df6bb9297e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:11.788345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46944436-8359-4fb9-a105-81df6bb9297e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:11.788937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46944436-8359-4fb9-a105-81df6bb9297e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:11.811972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-b797f71f-56ce-4928-9661-9b15dc540c5e req-7b76d6c4-953f-441f-815d-b9f68ffb3fe1 service nova] Creating event network-vif-deleted:5823fd96-0a74-4a99-a781-5fdd4ec37776 for instance b47aefa9-f290-45b9-b10e-051bba4b7aa2 on hv-cinder-84301 May 24 13:02:11.833402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-b797f71f-56ce-4928-9661-9b15dc540c5e req-7b76d6c4-953f-441f-815d-b9f68ffb3fe1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079917 May 24 13:02:11.835202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 186/361] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:02:11.974154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-46944436-8359-4fb9-a105-81df6bb9297e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:11.984676 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-46944436-8359-4fb9-a105-81df6bb9297e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.212464 May 24 13:02:11.995521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 176/362] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:11 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:12.576468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:12.577185 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: b47aefa9-f290-45b9-b10e-051bba4b7aa2] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:12.586042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:12.586512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:12.587275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:12.587704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:12.601858 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] HTTP exception thrown: Instance b47aefa9-f290-45b9-b10e-051bba4b7aa2 could not be found. May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Request method failure captured: May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 HTTP/1.1 May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNcpMWIOoNkjhMMdTTYeXC_uYcMhJfJi2kYq6DVZWc3Z2HD__Zggs6uiFwXs56kPoKlUBL6u6WdywEqTBZXD5Kl1pOn2FjC3OVx-ZOAlzLWsI2myi3oYIQGguU3k8dfvdgVSlNWr5yduaumD0FtJzQMhZQr0FLz0_rtlHvGse_56rzQ May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 6f2aa286c68c473686a4c71190684e18 May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-VolumesActionsTest-1800950033 May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:02:12.604404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f2aa286c68c473686a4c71190684e18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f2aa286c68c473686a4c71190684e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f2aa286c68c473686a4c71190684e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f2aa286c68c473686a4c71190684e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-VolumesActionsTest-1800950033 May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 6f2aa286c68c473686a4c71190684e18 May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-VolumesActionsTest-1800950033 May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-VolumesActionsTest-1800950033-project May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 226c8c0918714060ac908316c7effc08 May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-VolumesActionsTest-1800950033-project May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance b47aefa9-f290-45b9-b10e-051bba4b7aa2 could not be found. May 24 13:02:12.605714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': 'b47aefa9-f290-45b9-b10e-051bba4b7aa2'} May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47aefa9-f290-45b9-b10e-051bba4b7aa2 could not be found. May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:12.606474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47aefa9-f290-45b9-b10e-051bba4b7aa2 could not be found. May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47aefa9-f290-45b9-b10e-051bba4b7aa2 could not be found. May 24 13:02:12.607658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:02:12.608811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Returning 404 to user: Instance b47aefa9-f290-45b9-b10e-051bba4b7aa2 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:12.608811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-177d42bd-7284-49ab-843b-465a659749d8 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2" status: 404 len: 111 microversion: 2.1 time: 0.034347 May 24 13:02:12.608811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 187/363] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:12 2022] GET /compute/v2.1/servers/b47aefa9-f290-45b9-b10e-051bba4b7aa2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:02:12.721827 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-955578588", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "networks": [{"uuid": "974075e8-4896-434f-8352-d3ab15000e1c"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:02:12.784994 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] validate_networks() for [('974075e8-4896-434f-8352-d3ab15000e1c', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:02:13.002099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4ad52e62-ae20-406c-97f0-36d1cdd58556 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:13.003496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4ad52e62-ae20-406c-97f0-36d1cdd58556 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:13.010831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4ad52e62-ae20-406c-97f0-36d1cdd58556 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:13.011288 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4ad52e62-ae20-406c-97f0-36d1cdd58556 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:13.012066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4ad52e62-ae20-406c-97f0-36d1cdd58556 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:13.012499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4ad52e62-ae20-406c-97f0-36d1cdd58556 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:13.189776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:02:13.190339 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:02:13.190815 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:02:13.191247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:02:13.191661 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:02:13.204730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:13.205223 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:13.206049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:13.206527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:13.231539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Getting quotas for project 6f2aa286c68c473686a4c71190684e18. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:02:13.239963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Getting quotas for user 226c8c0918714060ac908316c7effc08 and project 6f2aa286c68c473686a4c71190684e18. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:02:13.253624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-4ad52e62-ae20-406c-97f0-36d1cdd58556 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:13.257736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:02:13.261554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:02:13.266547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4ad52e62-ae20-406c-97f0-36d1cdd58556 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.267140 May 24 13:02:13.267394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 188/364] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:12 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:13.326995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-68c3b4db-e5ff-4713-8fa2-57a970853d38 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608994 May 24 13:02:13.328449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 177/365] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:02:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:02:13.339306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2a2671a4-965d-4e0d-80cc-a9cf0f6c8957 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:13.340114 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2a2671a4-965d-4e0d-80cc-a9cf0f6c8957 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:13.442153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2a2671a4-965d-4e0d-80cc-a9cf0f6c8957 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:13.450095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2a2671a4-965d-4e0d-80cc-a9cf0f6c8957 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1213 microversion: 2.1 time: 0.113754 May 24 13:02:13.462830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 189/366] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:13 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:14.285149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6aa75b4b-91cb-413e-9ffc-68f08b1ee19e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:14.285944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6aa75b4b-91cb-413e-9ffc-68f08b1ee19e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:14.292779 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa75b4b-91cb-413e-9ffc-68f08b1ee19e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:14.293263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa75b4b-91cb-413e-9ffc-68f08b1ee19e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:14.294715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa75b4b-91cb-413e-9ffc-68f08b1ee19e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:14.294715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa75b4b-91cb-413e-9ffc-68f08b1ee19e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:14.463087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6aa75b4b-91cb-413e-9ffc-68f08b1ee19e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:14.469827 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1902d6df-09a8-4b7a-b4bc-ef5d210e8de6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:14.470517 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6aa75b4b-91cb-413e-9ffc-68f08b1ee19e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.189268 May 24 13:02:14.470517 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 178/367] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:14 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:14.471135 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1902d6df-09a8-4b7a-b4bc-ef5d210e8de6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:14.482802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1902d6df-09a8-4b7a-b4bc-ef5d210e8de6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:14.483449 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1902d6df-09a8-4b7a-b4bc-ef5d210e8de6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:14.484413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1902d6df-09a8-4b7a-b4bc-ef5d210e8de6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:14.484866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1902d6df-09a8-4b7a-b4bc-ef5d210e8de6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:14.576574 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1902d6df-09a8-4b7a-b4bc-ef5d210e8de6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:14.586244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1902d6df-09a8-4b7a-b4bc-ef5d210e8de6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1265 microversion: 2.1 time: 0.121370 May 24 13:02:14.587084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 190/368] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:14 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:15.487454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f3ca9c92-b168-43d3-b39b-86bdbf30ec6e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:15.488271 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f3ca9c92-b168-43d3-b39b-86bdbf30ec6e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:15.492221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:15.497050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3ca9c92-b168-43d3-b39b-86bdbf30ec6e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:15.497581 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3ca9c92-b168-43d3-b39b-86bdbf30ec6e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:15.498502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3ca9c92-b168-43d3-b39b-86bdbf30ec6e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:15.498988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3ca9c92-b168-43d3-b39b-86bdbf30ec6e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:15.605559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-44ba2c43-0e90-4660-873a-654f2364d1c6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:15.606335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-44ba2c43-0e90-4660-873a-654f2364d1c6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:15.613869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44ba2c43-0e90-4660-873a-654f2364d1c6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:15.614554 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44ba2c43-0e90-4660-873a-654f2364d1c6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:15.615411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44ba2c43-0e90-4660-873a-654f2364d1c6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:15.615931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44ba2c43-0e90-4660-873a-654f2364d1c6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:15.728658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f3ca9c92-b168-43d3-b39b-86bdbf30ec6e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:15.736687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f3ca9c92-b168-43d3-b39b-86bdbf30ec6e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.253338 May 24 13:02:15.737809 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 179/369] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:15 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:15.772952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-44ba2c43-0e90-4660-873a-654f2364d1c6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:15.781377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-44ba2c43-0e90-4660-873a-654f2364d1c6 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1313 microversion: 2.1 time: 0.181199 May 24 13:02:15.782211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 191/370] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:15 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:16.137064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-d089802d-1703-4489-8667-eff88eac5ed3 req-e7fcff82-0b7d-4bac-a464-9ad2a10a98b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5953bc-4046-4810-9ca9-67893103bd2f", "tag": "e16c59e1-a0c2-4a69-986d-7c50368c71bf"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:02:16.157461 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d089802d-1703-4489-8667-eff88eac5ed3 req-e7fcff82-0b7d-4bac-a464-9ad2a10a98b4 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:16.158153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d089802d-1703-4489-8667-eff88eac5ed3 req-e7fcff82-0b7d-4bac-a464-9ad2a10a98b4 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:16.162977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:16.175379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-d089802d-1703-4489-8667-eff88eac5ed3 req-e7fcff82-0b7d-4bac-a464-9ad2a10a98b4 service nova] Creating event network-changed:e16c59e1-a0c2-4a69-986d-7c50368c71bf for instance be5953bc-4046-4810-9ca9-67893103bd2f on hv-cinder-84301 May 24 13:02:16.181641 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-d089802d-1703-4489-8667-eff88eac5ed3 req-e7fcff82-0b7d-4bac-a464-9ad2a10a98b4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063382 May 24 13:02:16.182405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 180/371] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:02:16.752884 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-eff31522-b88a-46a2-ad99-3a1c13bd28d2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:16.753427 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-eff31522-b88a-46a2-ad99-3a1c13bd28d2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:16.759777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eff31522-b88a-46a2-ad99-3a1c13bd28d2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:16.760235 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eff31522-b88a-46a2-ad99-3a1c13bd28d2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:16.761004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eff31522-b88a-46a2-ad99-3a1c13bd28d2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:16.761442 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eff31522-b88a-46a2-ad99-3a1c13bd28d2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:16.799698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-307b3a6a-5abe-4f91-aff0-8a31773cf106 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:16.800396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-307b3a6a-5abe-4f91-aff0-8a31773cf106 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:16.807365 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-307b3a6a-5abe-4f91-aff0-8a31773cf106 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:16.807812 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-307b3a6a-5abe-4f91-aff0-8a31773cf106 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:16.808581 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-307b3a6a-5abe-4f91-aff0-8a31773cf106 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:16.809016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-307b3a6a-5abe-4f91-aff0-8a31773cf106 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:16.896373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-eff31522-b88a-46a2-ad99-3a1c13bd28d2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:16.904032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-eff31522-b88a-46a2-ad99-3a1c13bd28d2 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.155031 May 24 13:02:16.904600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 192/372] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:16 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:16.941146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-307b3a6a-5abe-4f91-aff0-8a31773cf106 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:16.949312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-307b3a6a-5abe-4f91-aff0-8a31773cf106 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1313 microversion: 2.1 time: 0.154207 May 24 13:02:16.949871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 181/373] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:16 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:17.921096 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-645eb99c-9fa5-484b-b7da-ca1c4942c886 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:17.921723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-645eb99c-9fa5-484b-b7da-ca1c4942c886 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:17.928596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-645eb99c-9fa5-484b-b7da-ca1c4942c886 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:17.929047 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-645eb99c-9fa5-484b-b7da-ca1c4942c886 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:17.929810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-645eb99c-9fa5-484b-b7da-ca1c4942c886 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:17.930250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-645eb99c-9fa5-484b-b7da-ca1c4942c886 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:17.965947 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-92780412-eff2-4bdf-8407-6a47b7c3dbc9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:17.966577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-92780412-eff2-4bdf-8407-6a47b7c3dbc9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:17.973203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92780412-eff2-4bdf-8407-6a47b7c3dbc9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:17.973650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92780412-eff2-4bdf-8407-6a47b7c3dbc9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:17.974456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92780412-eff2-4bdf-8407-6a47b7c3dbc9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:17.974921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92780412-eff2-4bdf-8407-6a47b7c3dbc9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:18.063086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-645eb99c-9fa5-484b-b7da-ca1c4942c886 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:18.070633 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-645eb99c-9fa5-484b-b7da-ca1c4942c886 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.153357 May 24 13:02:18.071204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 193/374] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:17 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:18.109891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-92780412-eff2-4bdf-8407-6a47b7c3dbc9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:18.118226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-92780412-eff2-4bdf-8407-6a47b7c3dbc9 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1313 microversion: 2.1 time: 0.156084 May 24 13:02:18.118831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 182/375] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:17 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:19.087540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e11160ca-2255-4529-a85e-59391bf18156 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:19.088559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e11160ca-2255-4529-a85e-59391bf18156 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:19.095577 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e11160ca-2255-4529-a85e-59391bf18156 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:19.096031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e11160ca-2255-4529-a85e-59391bf18156 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:19.096805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e11160ca-2255-4529-a85e-59391bf18156 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:19.097248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e11160ca-2255-4529-a85e-59391bf18156 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:19.135911 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-97c8d872-7464-4306-8554-58692fc167cb tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:19.136837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-97c8d872-7464-4306-8554-58692fc167cb tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:19.144012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97c8d872-7464-4306-8554-58692fc167cb tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:19.144455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97c8d872-7464-4306-8554-58692fc167cb tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:19.145212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97c8d872-7464-4306-8554-58692fc167cb tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:19.145637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97c8d872-7464-4306-8554-58692fc167cb tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:19.234695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e11160ca-2255-4529-a85e-59391bf18156 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:19.243084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e11160ca-2255-4529-a85e-59391bf18156 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.159870 May 24 13:02:19.244137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 194/376] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:19 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:19.292751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-97c8d872-7464-4306-8554-58692fc167cb tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:19.300166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-97c8d872-7464-4306-8554-58692fc167cb tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1313 microversion: 2.1 time: 0.168698 May 24 13:02:19.300726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 183/377] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:19 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:20.260666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-34bf8c46-18ef-494c-a710-0aa61748f789 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:20.261288 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-34bf8c46-18ef-494c-a710-0aa61748f789 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:20.268287 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34bf8c46-18ef-494c-a710-0aa61748f789 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:20.269121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34bf8c46-18ef-494c-a710-0aa61748f789 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:20.270190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34bf8c46-18ef-494c-a710-0aa61748f789 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:20.270893 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34bf8c46-18ef-494c-a710-0aa61748f789 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:20.321990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e6a854e3-8aa1-44b9-a159-7a5fcc96a27b tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:20.322952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e6a854e3-8aa1-44b9-a159-7a5fcc96a27b tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:20.331155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6a854e3-8aa1-44b9-a159-7a5fcc96a27b tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:20.331612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6a854e3-8aa1-44b9-a159-7a5fcc96a27b tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:20.332397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6a854e3-8aa1-44b9-a159-7a5fcc96a27b tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:20.332834 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6a854e3-8aa1-44b9-a159-7a5fcc96a27b tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:20.506429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e6a854e3-8aa1-44b9-a159-7a5fcc96a27b tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:20.515572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e6a854e3-8aa1-44b9-a159-7a5fcc96a27b tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1313 microversion: 2.1 time: 0.199397 May 24 13:02:20.516920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 184/378] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:20 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:20.532791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-34bf8c46-18ef-494c-a710-0aa61748f789 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:20.541074 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-34bf8c46-18ef-494c-a710-0aa61748f789 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.284277 May 24 13:02:20.541656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 195/379] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:20 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:21.533995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eddfcc71-df97-4728-8b14-c00fd10ecba0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:21.534629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eddfcc71-df97-4728-8b14-c00fd10ecba0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:21.543615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eddfcc71-df97-4728-8b14-c00fd10ecba0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:21.544061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eddfcc71-df97-4728-8b14-c00fd10ecba0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:21.544821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eddfcc71-df97-4728-8b14-c00fd10ecba0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:21.545249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eddfcc71-df97-4728-8b14-c00fd10ecba0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:21.558045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c41c7e11-8178-4174-8733-69d5b7c003e9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:21.558779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c41c7e11-8178-4174-8733-69d5b7c003e9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:21.566716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c41c7e11-8178-4174-8733-69d5b7c003e9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:21.567252 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c41c7e11-8178-4174-8733-69d5b7c003e9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:21.568887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c41c7e11-8178-4174-8733-69d5b7c003e9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:21.569680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c41c7e11-8178-4174-8733-69d5b7c003e9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:21.720793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eddfcc71-df97-4728-8b14-c00fd10ecba0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:21.730891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eddfcc71-df97-4728-8b14-c00fd10ecba0 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1313 microversion: 2.1 time: 0.201437 May 24 13:02:21.737699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 185/380] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:21 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:21.770558 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c41c7e11-8178-4174-8733-69d5b7c003e9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:21.779314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c41c7e11-8178-4174-8733-69d5b7c003e9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.225686 May 24 13:02:21.779976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 196/381] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:21 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:22.753592 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6bf1a950-83dc-4d90-9b30-f076698dfc8e tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:22.754211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6bf1a950-83dc-4d90-9b30-f076698dfc8e tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:22.763963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf1a950-83dc-4d90-9b30-f076698dfc8e tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:22.764400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf1a950-83dc-4d90-9b30-f076698dfc8e tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:22.765250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf1a950-83dc-4d90-9b30-f076698dfc8e tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:22.765681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf1a950-83dc-4d90-9b30-f076698dfc8e tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:22.796408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0b021b71-fd5f-4df7-b256-b7e01b9b7c72 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:22.797021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0b021b71-fd5f-4df7-b256-b7e01b9b7c72 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:22.803741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b021b71-fd5f-4df7-b256-b7e01b9b7c72 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:22.804189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b021b71-fd5f-4df7-b256-b7e01b9b7c72 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:22.804954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b021b71-fd5f-4df7-b256-b7e01b9b7c72 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:22.805391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b021b71-fd5f-4df7-b256-b7e01b9b7c72 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:22.902310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6bf1a950-83dc-4d90-9b30-f076698dfc8e tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:22.909650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6bf1a950-83dc-4d90-9b30-f076698dfc8e tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1313 microversion: 2.1 time: 0.163255 May 24 13:02:22.910209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 186/382] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:22 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:22.936825 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0b021b71-fd5f-4df7-b256-b7e01b9b7c72 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:22.944343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0b021b71-fd5f-4df7-b256-b7e01b9b7c72 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.151734 May 24 13:02:22.944913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 197/383] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:22 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:23.117776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-973daf3e-09e4-41fe-a44e-03f0af4ffaea req-0e8389f9-3c51-422f-adb3-373ae5812564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5953bc-4046-4810-9ca9-67893103bd2f", "name": "network-vif-plugged", "status": "completed", "tag": "e16c59e1-a0c2-4a69-986d-7c50368c71bf"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:02:23.126489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-973daf3e-09e4-41fe-a44e-03f0af4ffaea req-0e8389f9-3c51-422f-adb3-373ae5812564 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:23.126935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-973daf3e-09e4-41fe-a44e-03f0af4ffaea req-0e8389f9-3c51-422f-adb3-373ae5812564 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:23.138975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-973daf3e-09e4-41fe-a44e-03f0af4ffaea req-0e8389f9-3c51-422f-adb3-373ae5812564 service nova] Creating event network-vif-plugged:e16c59e1-a0c2-4a69-986d-7c50368c71bf for instance be5953bc-4046-4810-9ca9-67893103bd2f on hv-cinder-84301 May 24 13:02:23.143790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-973daf3e-09e4-41fe-a44e-03f0af4ffaea req-0e8389f9-3c51-422f-adb3-373ae5812564 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029735 May 24 13:02:23.144382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 187/384] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:02:23.924220 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:23.928482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c8928a32-5bf4-4939-ba1d-fa7c805c3c2a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:23.929102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c8928a32-5bf4-4939-ba1d-fa7c805c3c2a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:23.935815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8928a32-5bf4-4939-ba1d-fa7c805c3c2a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:23.936271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8928a32-5bf4-4939-ba1d-fa7c805c3c2a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:23.937043 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8928a32-5bf4-4939-ba1d-fa7c805c3c2a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:23.937489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8928a32-5bf4-4939-ba1d-fa7c805c3c2a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:23.958042 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:23.959732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:23.964843 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5acb00db-ac99-42aa-b010-82af345a976e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:23.965548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5acb00db-ac99-42aa-b010-82af345a976e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:23.972926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5acb00db-ac99-42aa-b010-82af345a976e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:23.973375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5acb00db-ac99-42aa-b010-82af345a976e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:23.974141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5acb00db-ac99-42aa-b010-82af345a976e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:23.974609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5acb00db-ac99-42aa-b010-82af345a976e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:24.069660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c8928a32-5bf4-4939-ba1d-fa7c805c3c2a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:24.077627 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c8928a32-5bf4-4939-ba1d-fa7c805c3c2a tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1313 microversion: 2.1 time: 0.154389 May 24 13:02:24.078202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 198/385] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:23 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:24.105518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5acb00db-ac99-42aa-b010-82af345a976e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:24.113118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5acb00db-ac99-42aa-b010-82af345a976e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.155943 May 24 13:02:24.113681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 188/386] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:23 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:25.094212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-668a47be-f426-480c-a327-d310cf3d72a2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:25.094956 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-668a47be-f426-480c-a327-d310cf3d72a2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:25.101237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-668a47be-f426-480c-a327-d310cf3d72a2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:25.101691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-668a47be-f426-480c-a327-d310cf3d72a2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:25.102488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-668a47be-f426-480c-a327-d310cf3d72a2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:25.102969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-668a47be-f426-480c-a327-d310cf3d72a2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:25.131337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a47c0929-4260-4c6d-a323-95e39bd3b470 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:25.131946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a47c0929-4260-4c6d-a323-95e39bd3b470 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:25.138182 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a47c0929-4260-4c6d-a323-95e39bd3b470 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:25.138903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a47c0929-4260-4c6d-a323-95e39bd3b470 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:25.139780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a47c0929-4260-4c6d-a323-95e39bd3b470 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:25.140394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a47c0929-4260-4c6d-a323-95e39bd3b470 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:25.251028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-668a47be-f426-480c-a327-d310cf3d72a2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:25.263504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-668a47be-f426-480c-a327-d310cf3d72a2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1313 microversion: 2.1 time: 0.172807 May 24 13:02:25.264320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 199/387] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:25 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:25.306022 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a47c0929-4260-4c6d-a323-95e39bd3b470 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:25.321352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a47c0929-4260-4c6d-a323-95e39bd3b470 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.194461 May 24 13:02:25.322063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 189/388] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:25 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:26.280940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2ff1e132-df7e-412f-9cb8-8d5834ee8990 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:26.281555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2ff1e132-df7e-412f-9cb8-8d5834ee8990 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:26.287673 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ff1e132-df7e-412f-9cb8-8d5834ee8990 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:26.288121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ff1e132-df7e-412f-9cb8-8d5834ee8990 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:26.288885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ff1e132-df7e-412f-9cb8-8d5834ee8990 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:26.289320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ff1e132-df7e-412f-9cb8-8d5834ee8990 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:26.339144 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b0a87e2f-20f5-4d7d-975d-0a0432f90c46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:26.339763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b0a87e2f-20f5-4d7d-975d-0a0432f90c46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:26.346232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0a87e2f-20f5-4d7d-975d-0a0432f90c46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:26.346715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0a87e2f-20f5-4d7d-975d-0a0432f90c46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:26.347478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0a87e2f-20f5-4d7d-975d-0a0432f90c46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:26.347908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0a87e2f-20f5-4d7d-975d-0a0432f90c46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:26.432768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2ff1e132-df7e-412f-9cb8-8d5834ee8990 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:26.440402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2ff1e132-df7e-412f-9cb8-8d5834ee8990 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1498 microversion: 2.1 time: 0.163238 May 24 13:02:26.440981 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 200/389] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:26 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:26.485275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b0a87e2f-20f5-4d7d-975d-0a0432f90c46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:26.493896 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b0a87e2f-20f5-4d7d-975d-0a0432f90c46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.158659 May 24 13:02:26.494509 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 190/390] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:26 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:27.510256 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4956c648-93a5-4fe9-80fe-e15227ada75f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:27.510907 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4956c648-93a5-4fe9-80fe-e15227ada75f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:27.512851 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:27.518244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4956c648-93a5-4fe9-80fe-e15227ada75f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:27.518733 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4956c648-93a5-4fe9-80fe-e15227ada75f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:27.519548 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4956c648-93a5-4fe9-80fe-e15227ada75f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:27.520002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4956c648-93a5-4fe9-80fe-e15227ada75f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:27.537880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:27.657153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-4956c648-93a5-4fe9-80fe-e15227ada75f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:27.665388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4956c648-93a5-4fe9-80fe-e15227ada75f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.158804 May 24 13:02:27.665901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 201/391] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:27 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:28.682323 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-42e282fb-995a-409b-b7be-f26471faf21a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:28.682863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-42e282fb-995a-409b-b7be-f26471faf21a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:28.689265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42e282fb-995a-409b-b7be-f26471faf21a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:28.689705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42e282fb-995a-409b-b7be-f26471faf21a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:28.690491 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42e282fb-995a-409b-b7be-f26471faf21a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:28.690917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42e282fb-995a-409b-b7be-f26471faf21a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:28.817730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-42e282fb-995a-409b-b7be-f26471faf21a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:28.825203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-42e282fb-995a-409b-b7be-f26471faf21a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.146730 May 24 13:02:28.825752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 191/392] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:28 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:29.842436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8abec23c-de14-44b3-a357-991c09f74374 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:29.843050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8abec23c-de14-44b3-a357-991c09f74374 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:29.849864 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8abec23c-de14-44b3-a357-991c09f74374 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:29.850326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8abec23c-de14-44b3-a357-991c09f74374 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:29.851082 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8abec23c-de14-44b3-a357-991c09f74374 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:29.851533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8abec23c-de14-44b3-a357-991c09f74374 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:29.978098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8abec23c-de14-44b3-a357-991c09f74374 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:29.985398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8abec23c-de14-44b3-a357-991c09f74374 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.146877 May 24 13:02:29.985962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 202/393] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:29 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:31.002887 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-64d1802e-7df2-4bad-86a8-885dcb5732ad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:31.003630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-64d1802e-7df2-4bad-86a8-885dcb5732ad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:31.010744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64d1802e-7df2-4bad-86a8-885dcb5732ad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:31.011195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64d1802e-7df2-4bad-86a8-885dcb5732ad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:31.011961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64d1802e-7df2-4bad-86a8-885dcb5732ad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:31.012485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64d1802e-7df2-4bad-86a8-885dcb5732ad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:31.140826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-64d1802e-7df2-4bad-86a8-885dcb5732ad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:31.148891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-64d1802e-7df2-4bad-86a8-885dcb5732ad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.149866 May 24 13:02:31.149453 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 192/394] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:30 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:32.165347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-56803f41-e19e-4779-a417-4e500e68262a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:32.165959 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-56803f41-e19e-4779-a417-4e500e68262a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:32.172273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56803f41-e19e-4779-a417-4e500e68262a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:32.173213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56803f41-e19e-4779-a417-4e500e68262a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:32.173963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56803f41-e19e-4779-a417-4e500e68262a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:32.174487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56803f41-e19e-4779-a417-4e500e68262a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:32.301702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-56803f41-e19e-4779-a417-4e500e68262a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:32.309595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-56803f41-e19e-4779-a417-4e500e68262a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.148120 May 24 13:02:32.310159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 203/395] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:32 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:33.031507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-04b6392f-e2ea-4347-8f88-a79f8fb9314d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:33.032091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-04b6392f-e2ea-4347-8f88-a79f8fb9314d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:33.040556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04b6392f-e2ea-4347-8f88-a79f8fb9314d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:33.041136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04b6392f-e2ea-4347-8f88-a79f8fb9314d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:33.041899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04b6392f-e2ea-4347-8f88-a79f8fb9314d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:33.042350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04b6392f-e2ea-4347-8f88-a79f8fb9314d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:33.080511 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-04b6392f-e2ea-4347-8f88-a79f8fb9314d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:02:33.174529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-04b6392f-e2ea-4347-8f88-a79f8fb9314d tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "DELETE /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 204 len: 0 microversion: 2.1 time: 0.146833 May 24 13:02:33.175534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 193/396] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:02:33 2022] DELETE /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:02:33.190628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ab8f3ad8-130e-45e0-a08d-10c746830d34 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:33.190628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ab8f3ad8-130e-45e0-a08d-10c746830d34 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:33.192437 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ab8f3ad8-130e-45e0-a08d-10c746830d34 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:33.193397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ab8f3ad8-130e-45e0-a08d-10c746830d34 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:33.194240 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ab8f3ad8-130e-45e0-a08d-10c746830d34 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:33.194710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ab8f3ad8-130e-45e0-a08d-10c746830d34 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:33.327216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-77cf59fa-9238-43d1-bdde-59b986bc0342 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:33.327921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-77cf59fa-9238-43d1-bdde-59b986bc0342 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:33.331757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ab8f3ad8-130e-45e0-a08d-10c746830d34 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:33.334785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77cf59fa-9238-43d1-bdde-59b986bc0342 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:33.335697 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77cf59fa-9238-43d1-bdde-59b986bc0342 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:33.336529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77cf59fa-9238-43d1-bdde-59b986bc0342 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:33.337043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77cf59fa-9238-43d1-bdde-59b986bc0342 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:33.344726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ab8f3ad8-130e-45e0-a08d-10c746830d34 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.163895 May 24 13:02:33.345316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 204/397] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:33 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:33.676368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-77cf59fa-9238-43d1-bdde-59b986bc0342 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:33.683717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-77cf59fa-9238-43d1-bdde-59b986bc0342 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.360757 May 24 13:02:33.693108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 194/398] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:33 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:34.363812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5876f92c-b5fe-44d4-977a-9f1cd90d0aec tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:34.364528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5876f92c-b5fe-44d4-977a-9f1cd90d0aec tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:34.371085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5876f92c-b5fe-44d4-977a-9f1cd90d0aec tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:34.371611 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5876f92c-b5fe-44d4-977a-9f1cd90d0aec tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:34.372459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5876f92c-b5fe-44d4-977a-9f1cd90d0aec tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:34.373089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5876f92c-b5fe-44d4-977a-9f1cd90d0aec tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:34.522560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5876f92c-b5fe-44d4-977a-9f1cd90d0aec tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:34.535412 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5876f92c-b5fe-44d4-977a-9f1cd90d0aec tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.176185 May 24 13:02:34.537343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 205/399] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:34 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:34.699796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-89b61786-1bf8-444e-9c92-8a879a65de52 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:34.700411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-89b61786-1bf8-444e-9c92-8a879a65de52 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:34.708129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89b61786-1bf8-444e-9c92-8a879a65de52 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:34.709687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89b61786-1bf8-444e-9c92-8a879a65de52 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:34.710526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89b61786-1bf8-444e-9c92-8a879a65de52 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:34.710976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89b61786-1bf8-444e-9c92-8a879a65de52 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:34.898959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-89b61786-1bf8-444e-9c92-8a879a65de52 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:34.908225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-89b61786-1bf8-444e-9c92-8a879a65de52 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.212198 May 24 13:02:34.908811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 195/400] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:34 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:35.553392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fefbf54a-184a-45f5-b980-57fa2d55aa24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:35.554030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fefbf54a-184a-45f5-b980-57fa2d55aa24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:35.560057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fefbf54a-184a-45f5-b980-57fa2d55aa24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:35.560503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fefbf54a-184a-45f5-b980-57fa2d55aa24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:35.561263 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fefbf54a-184a-45f5-b980-57fa2d55aa24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:35.561700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fefbf54a-184a-45f5-b980-57fa2d55aa24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:35.689746 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-fefbf54a-184a-45f5-b980-57fa2d55aa24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:35.697642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fefbf54a-184a-45f5-b980-57fa2d55aa24 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.148699 May 24 13:02:35.698208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 206/401] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:35 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:35.924661 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e0cb53a5-d107-48cb-b40d-41eb783a5695 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:35.925272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e0cb53a5-d107-48cb-b40d-41eb783a5695 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:35.931981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0cb53a5-d107-48cb-b40d-41eb783a5695 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:35.932463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0cb53a5-d107-48cb-b40d-41eb783a5695 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:35.933216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0cb53a5-d107-48cb-b40d-41eb783a5695 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:35.933645 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0cb53a5-d107-48cb-b40d-41eb783a5695 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:35.948574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:36.063329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e0cb53a5-d107-48cb-b40d-41eb783a5695 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:36.071086 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e0cb53a5-d107-48cb-b40d-41eb783a5695 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.150245 May 24 13:02:36.071652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 196/402] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:35 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:36.714768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-03de4f20-2cde-46dc-84dd-507858eff5f2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:36.715379 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-03de4f20-2cde-46dc-84dd-507858eff5f2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:36.721394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03de4f20-2cde-46dc-84dd-507858eff5f2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:36.721836 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03de4f20-2cde-46dc-84dd-507858eff5f2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:36.722619 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03de4f20-2cde-46dc-84dd-507858eff5f2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:36.723050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03de4f20-2cde-46dc-84dd-507858eff5f2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:36.856034 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-03de4f20-2cde-46dc-84dd-507858eff5f2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:36.863608 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-03de4f20-2cde-46dc-84dd-507858eff5f2 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.152620 May 24 13:02:36.864306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 207/403] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:36 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:37.088147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8dbf558d-d4f4-4168-9261-ddbce56fb40d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:37.088861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8dbf558d-d4f4-4168-9261-ddbce56fb40d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:37.095625 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dbf558d-d4f4-4168-9261-ddbce56fb40d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:37.096160 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dbf558d-d4f4-4168-9261-ddbce56fb40d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:37.096926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dbf558d-d4f4-4168-9261-ddbce56fb40d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:37.097366 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dbf558d-d4f4-4168-9261-ddbce56fb40d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:37.270434 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8dbf558d-d4f4-4168-9261-ddbce56fb40d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:37.277932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8dbf558d-d4f4-4168-9261-ddbce56fb40d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.194223 May 24 13:02:37.278534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 197/404] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:37 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:37.883806 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8fa4f91d-6989-4fbe-a6d9-cbe3ee3e7c05 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:37.884488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8fa4f91d-6989-4fbe-a6d9-cbe3ee3e7c05 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:37.891486 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8fa4f91d-6989-4fbe-a6d9-cbe3ee3e7c05 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:37.892299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8fa4f91d-6989-4fbe-a6d9-cbe3ee3e7c05 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:37.893117 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8fa4f91d-6989-4fbe-a6d9-cbe3ee3e7c05 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:37.893824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8fa4f91d-6989-4fbe-a6d9-cbe3ee3e7c05 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:38.073383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8fa4f91d-6989-4fbe-a6d9-cbe3ee3e7c05 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:38.081763 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8fa4f91d-6989-4fbe-a6d9-cbe3ee3e7c05 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.202947 May 24 13:02:38.082377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 208/405] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:37 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:38.295817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7825828a-814c-4884-a93d-2960c8ba822c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:38.296526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7825828a-814c-4884-a93d-2960c8ba822c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:38.303571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7825828a-814c-4884-a93d-2960c8ba822c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:38.304021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7825828a-814c-4884-a93d-2960c8ba822c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:38.304781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7825828a-814c-4884-a93d-2960c8ba822c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:38.305215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7825828a-814c-4884-a93d-2960c8ba822c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:38.446696 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7825828a-814c-4884-a93d-2960c8ba822c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:38.455941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7825828a-814c-4884-a93d-2960c8ba822c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.163897 May 24 13:02:38.456796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 198/406] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:38 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:39.099855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d36dfdad-1893-40ea-bcb6-b1967df18332 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:39.100471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d36dfdad-1893-40ea-bcb6-b1967df18332 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:39.106554 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d36dfdad-1893-40ea-bcb6-b1967df18332 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:39.107056 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d36dfdad-1893-40ea-bcb6-b1967df18332 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:39.107824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d36dfdad-1893-40ea-bcb6-b1967df18332 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:39.108261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d36dfdad-1893-40ea-bcb6-b1967df18332 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:39.236522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d36dfdad-1893-40ea-bcb6-b1967df18332 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:39.244848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d36dfdad-1893-40ea-bcb6-b1967df18332 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.149117 May 24 13:02:39.245570 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 209/407] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:39 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:39.474851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2468d1c8-57b6-4fe6-99b0-bab2fc47addc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:39.477011 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2468d1c8-57b6-4fe6-99b0-bab2fc47addc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:39.484124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2468d1c8-57b6-4fe6-99b0-bab2fc47addc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:39.484570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2468d1c8-57b6-4fe6-99b0-bab2fc47addc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:39.485364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2468d1c8-57b6-4fe6-99b0-bab2fc47addc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:39.485798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2468d1c8-57b6-4fe6-99b0-bab2fc47addc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:39.622175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2468d1c8-57b6-4fe6-99b0-bab2fc47addc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:39.629734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2468d1c8-57b6-4fe6-99b0-bab2fc47addc tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.160895 May 24 13:02:39.630361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 199/408] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:39 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:40.262183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9b068fa1-0d1e-4719-b405-f6529b93a590 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:40.262846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9b068fa1-0d1e-4719-b405-f6529b93a590 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:40.268867 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b068fa1-0d1e-4719-b405-f6529b93a590 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:40.269315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b068fa1-0d1e-4719-b405-f6529b93a590 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:40.270076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b068fa1-0d1e-4719-b405-f6529b93a590 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:40.270555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b068fa1-0d1e-4719-b405-f6529b93a590 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:40.398672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9b068fa1-0d1e-4719-b405-f6529b93a590 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:40.406233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9b068fa1-0d1e-4719-b405-f6529b93a590 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.147836 May 24 13:02:40.406830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 210/409] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:40 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:40.645535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0933ae4f-b183-44fb-9dee-ba1ff0635b24 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:40.646888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0933ae4f-b183-44fb-9dee-ba1ff0635b24 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:40.653808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0933ae4f-b183-44fb-9dee-ba1ff0635b24 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:40.654259 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0933ae4f-b183-44fb-9dee-ba1ff0635b24 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:40.655056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0933ae4f-b183-44fb-9dee-ba1ff0635b24 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:40.655514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0933ae4f-b183-44fb-9dee-ba1ff0635b24 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:40.786932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0933ae4f-b183-44fb-9dee-ba1ff0635b24 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:40.794397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0933ae4f-b183-44fb-9dee-ba1ff0635b24 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.152833 May 24 13:02:40.794960 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 200/410] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:40 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:41.424453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1dac7b4b-017c-4344-b737-943ced9ea655 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:41.425067 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1dac7b4b-017c-4344-b737-943ced9ea655 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:41.431205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1dac7b4b-017c-4344-b737-943ced9ea655 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:41.431651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1dac7b4b-017c-4344-b737-943ced9ea655 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:41.432402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1dac7b4b-017c-4344-b737-943ced9ea655 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:41.432834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1dac7b4b-017c-4344-b737-943ced9ea655 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:41.561331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1dac7b4b-017c-4344-b737-943ced9ea655 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:41.569388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1dac7b4b-017c-4344-b737-943ced9ea655 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.148800 May 24 13:02:41.569955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 211/411] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:41 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:41.810462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62108f70-4b1e-4807-85bb-3fc14403d434 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:41.811010 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-62108f70-4b1e-4807-85bb-3fc14403d434 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:41.817521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62108f70-4b1e-4807-85bb-3fc14403d434 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:41.818505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62108f70-4b1e-4807-85bb-3fc14403d434 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:41.819257 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62108f70-4b1e-4807-85bb-3fc14403d434 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:41.819690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62108f70-4b1e-4807-85bb-3fc14403d434 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:41.946560 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-62108f70-4b1e-4807-85bb-3fc14403d434 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:41.953993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-62108f70-4b1e-4807-85bb-3fc14403d434 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.147520 May 24 13:02:41.954571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 201/412] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:41 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:42.586535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7bbacc16-93ed-410f-bade-1ba7a1943511 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:42.587156 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7bbacc16-93ed-410f-bade-1ba7a1943511 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:42.593265 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7bbacc16-93ed-410f-bade-1ba7a1943511 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:42.593722 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7bbacc16-93ed-410f-bade-1ba7a1943511 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:42.594522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7bbacc16-93ed-410f-bade-1ba7a1943511 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:42.594963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7bbacc16-93ed-410f-bade-1ba7a1943511 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:42.723349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7bbacc16-93ed-410f-bade-1ba7a1943511 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:42.731316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7bbacc16-93ed-410f-bade-1ba7a1943511 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.149112 May 24 13:02:42.731871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 212/413] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:42 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:42.971189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6bfb7c05-e30a-4511-852c-3a1acadc5594 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:42.971774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6bfb7c05-e30a-4511-852c-3a1acadc5594 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:42.978742 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bfb7c05-e30a-4511-852c-3a1acadc5594 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:42.979196 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bfb7c05-e30a-4511-852c-3a1acadc5594 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:42.979981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bfb7c05-e30a-4511-852c-3a1acadc5594 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:42.980413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bfb7c05-e30a-4511-852c-3a1acadc5594 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:43.112879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6bfb7c05-e30a-4511-852c-3a1acadc5594 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:43.121321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6bfb7c05-e30a-4511-852c-3a1acadc5594 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.154039 May 24 13:02:43.121878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 202/414] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:42 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:43.748831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d454ce12-d0ec-426d-b7b3-a4770483ce33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:43.749451 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d454ce12-d0ec-426d-b7b3-a4770483ce33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:43.755659 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d454ce12-d0ec-426d-b7b3-a4770483ce33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:43.756098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d454ce12-d0ec-426d-b7b3-a4770483ce33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:43.756850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d454ce12-d0ec-426d-b7b3-a4770483ce33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:43.757279 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d454ce12-d0ec-426d-b7b3-a4770483ce33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:43.882616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d454ce12-d0ec-426d-b7b3-a4770483ce33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:43.890003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d454ce12-d0ec-426d-b7b3-a4770483ce33 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1504 microversion: 2.1 time: 0.145835 May 24 13:02:43.890587 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 213/415] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:43 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:44.138066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-730d2fb2-6088-4fde-9990-7cde606440e0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:44.138737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-730d2fb2-6088-4fde-9990-7cde606440e0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:44.145374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-730d2fb2-6088-4fde-9990-7cde606440e0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:44.145828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-730d2fb2-6088-4fde-9990-7cde606440e0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:44.146623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-730d2fb2-6088-4fde-9990-7cde606440e0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:44.147062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-730d2fb2-6088-4fde-9990-7cde606440e0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:44.374872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-e90ea85d-6aed-499f-83bd-3cb0b39745f8 req-f29c5029-a79d-4b50-b881-c50d8e8501c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5953bc-4046-4810-9ca9-67893103bd2f", "name": "network-vif-deleted", "tag": "e16c59e1-a0c2-4a69-986d-7c50368c71bf"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:02:44.376027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-730d2fb2-6088-4fde-9990-7cde606440e0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:44.383935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-e90ea85d-6aed-499f-83bd-3cb0b39745f8 req-f29c5029-a79d-4b50-b881-c50d8e8501c1 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:44.384582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-e90ea85d-6aed-499f-83bd-3cb0b39745f8 req-f29c5029-a79d-4b50-b881-c50d8e8501c1 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:44.385381 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-730d2fb2-6088-4fde-9990-7cde606440e0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.251059 May 24 13:02:44.386096 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 203/416] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:44 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:44.397653 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-e90ea85d-6aed-499f-83bd-3cb0b39745f8 req-f29c5029-a79d-4b50-b881-c50d8e8501c1 service nova] Creating event network-vif-deleted:e16c59e1-a0c2-4a69-986d-7c50368c71bf for instance be5953bc-4046-4810-9ca9-67893103bd2f on hv-cinder-84301 May 24 13:02:44.403142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-e90ea85d-6aed-499f-83bd-3cb0b39745f8 req-f29c5029-a79d-4b50-b881-c50d8e8501c1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031869 May 24 13:02:44.404046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 214/417] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:02:44.906846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-131abe0b-ef57-4f9e-85fe-8ae68591559c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:44.907455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-131abe0b-ef57-4f9e-85fe-8ae68591559c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:44.914423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-131abe0b-ef57-4f9e-85fe-8ae68591559c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:44.914868 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-131abe0b-ef57-4f9e-85fe-8ae68591559c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:44.915620 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-131abe0b-ef57-4f9e-85fe-8ae68591559c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:44.916049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-131abe0b-ef57-4f9e-85fe-8ae68591559c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:44.976153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-131abe0b-ef57-4f9e-85fe-8ae68591559c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226c8c0918714060ac908316c7effc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2aa286c68c473686a4c71190684e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:44.983851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-131abe0b-ef57-4f9e-85fe-8ae68591559c tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 200 len: 1462 microversion: 2.1 time: 0.080843 May 24 13:02:44.984425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 204/418] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:44 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 1462 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:45.403100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d3ef21d4-6301-4818-bd08-5d8607735ed6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:45.403913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d3ef21d4-6301-4818-bd08-5d8607735ed6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:45.410624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3ef21d4-6301-4818-bd08-5d8607735ed6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:45.411079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3ef21d4-6301-4818-bd08-5d8607735ed6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:45.411854 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3ef21d4-6301-4818-bd08-5d8607735ed6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:45.412287 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3ef21d4-6301-4818-bd08-5d8607735ed6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:45.559171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d3ef21d4-6301-4818-bd08-5d8607735ed6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:45.566660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d3ef21d4-6301-4818-bd08-5d8607735ed6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.167826 May 24 13:02:45.567234 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 215/419] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:45 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:46.002345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:46.003038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] [instance: be5953bc-4046-4810-9ca9-67893103bd2f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:46.005341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:46.010533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:46.010987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:46.011744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:46.012175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:46.026342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] HTTP exception thrown: Instance be5953bc-4046-4810-9ca9-67893103bd2f could not be found. May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Request method failure captured: May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f HTTP/1.1 May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNcpMWIOoNkjhMMdTTYeXC_uYcMhJfJi2kYq6DVZWc3Z2HD__Zggs6uiFwXs56kPoKlUBL6u6WdywEqTBZXD5Kl1pOn2FjC3OVx-ZOAlzLWsI2myi3oYIQGguU3k8dfvdgVSlNWr5yduaumD0FtJzQMhZQr0FLz0_rtlHvGse_56rzQ May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 6f2aa286c68c473686a4c71190684e18 May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesActionsTest-1800950033 May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:02:46.027892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f2aa286c68c473686a4c71190684e18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f2aa286c68c473686a4c71190684e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f2aa286c68c473686a4c71190684e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f2aa286c68c473686a4c71190684e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesActionsTest-1800950033 May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 6f2aa286c68c473686a4c71190684e18 May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesActionsTest-1800950033 May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesActionsTest-1800950033-project May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 226c8c0918714060ac908316c7effc08 May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesActionsTest-1800950033-project May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance be5953bc-4046-4810-9ca9-67893103bd2f could not be found. May 24 13:02:46.029629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'be5953bc-4046-4810-9ca9-67893103bd2f'} May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5953bc-4046-4810-9ca9-67893103bd2f could not be found. May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:02:46.031099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5953bc-4046-4810-9ca9-67893103bd2f could not be found. May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5953bc-4046-4810-9ca9-67893103bd2f could not be found. May 24 13:02:46.033064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:02:46.035003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] Returning 404 to user: Instance be5953bc-4046-4810-9ca9-67893103bd2f could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:02:46.035003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-08314c18-a860-473c-9317-f326791eb983 tempest-VolumesActionsTest-1800950033 tempest-VolumesActionsTest-1800950033-project] 10.222.0.45 "GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f" status: 404 len: 111 microversion: 2.1 time: 0.032012 May 24 13:02:46.035003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 205/420] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:45 2022] GET /compute/v2.1/servers/be5953bc-4046-4810-9ca9-67893103bd2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:02:46.586091 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b92c5830-a8d7-4d3f-adff-fca39da0f696 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:46.586932 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b92c5830-a8d7-4d3f-adff-fca39da0f696 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:46.609258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b92c5830-a8d7-4d3f-adff-fca39da0f696 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:46.609258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b92c5830-a8d7-4d3f-adff-fca39da0f696 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:46.609258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b92c5830-a8d7-4d3f-adff-fca39da0f696 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:46.609258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b92c5830-a8d7-4d3f-adff-fca39da0f696 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:46.750664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b92c5830-a8d7-4d3f-adff-fca39da0f696 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:46.760418 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b92c5830-a8d7-4d3f-adff-fca39da0f696 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.180047 May 24 13:02:46.761050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 216/421] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:46 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:47.777007 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5806f4c2-e6eb-44e6-87b6-28980cbe733d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:47.777618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5806f4c2-e6eb-44e6-87b6-28980cbe733d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:47.784250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5806f4c2-e6eb-44e6-87b6-28980cbe733d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:47.784694 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5806f4c2-e6eb-44e6-87b6-28980cbe733d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:47.785449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5806f4c2-e6eb-44e6-87b6-28980cbe733d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:47.785892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5806f4c2-e6eb-44e6-87b6-28980cbe733d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:47.915592 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5806f4c2-e6eb-44e6-87b6-28980cbe733d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:47.922963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5806f4c2-e6eb-44e6-87b6-28980cbe733d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.149787 May 24 13:02:47.923521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 206/422] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:47 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:48.939765 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9e2c3892-74db-41be-888a-4e36c749a182 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:48.940328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9e2c3892-74db-41be-888a-4e36c749a182 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:48.947006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9e2c3892-74db-41be-888a-4e36c749a182 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:48.947450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9e2c3892-74db-41be-888a-4e36c749a182 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:48.948200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9e2c3892-74db-41be-888a-4e36c749a182 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:48.948637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9e2c3892-74db-41be-888a-4e36c749a182 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:49.076133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9e2c3892-74db-41be-888a-4e36c749a182 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:49.084251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9e2c3892-74db-41be-888a-4e36c749a182 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.148430 May 24 13:02:49.084825 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 217/423] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:48 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:50.100719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f0a52da6-a85e-490e-8540-713657702914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:50.101988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f0a52da6-a85e-490e-8540-713657702914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:50.108655 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0a52da6-a85e-490e-8540-713657702914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:50.109105 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0a52da6-a85e-490e-8540-713657702914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:50.109860 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0a52da6-a85e-490e-8540-713657702914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:50.110318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0a52da6-a85e-490e-8540-713657702914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:50.238645 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f0a52da6-a85e-490e-8540-713657702914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:50.247035 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f0a52da6-a85e-490e-8540-713657702914 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.150168 May 24 13:02:50.247593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 207/424] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:50 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:02:51.264203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3d2cccfc-8f51-44db-8b82-9e04410999b5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:51.265044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3d2cccfc-8f51-44db-8b82-9e04410999b5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:51.272450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d2cccfc-8f51-44db-8b82-9e04410999b5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:51.272890 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d2cccfc-8f51-44db-8b82-9e04410999b5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:51.273648 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d2cccfc-8f51-44db-8b82-9e04410999b5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:51.274081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d2cccfc-8f51-44db-8b82-9e04410999b5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:51.404411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3d2cccfc-8f51-44db-8b82-9e04410999b5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:51.406815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:51.413846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3d2cccfc-8f51-44db-8b82-9e04410999b5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.153993 May 24 13:02:51.414440 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 218/425] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:51 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:52.430680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-011ddf71-4866-4587-a811-e03478ab549c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:52.431286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-011ddf71-4866-4587-a811-e03478ab549c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:52.438308 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-011ddf71-4866-4587-a811-e03478ab549c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:52.438761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-011ddf71-4866-4587-a811-e03478ab549c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:52.439550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-011ddf71-4866-4587-a811-e03478ab549c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:52.440011 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-011ddf71-4866-4587-a811-e03478ab549c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:52.585201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-011ddf71-4866-4587-a811-e03478ab549c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:52.592768 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-011ddf71-4866-4587-a811-e03478ab549c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.166149 May 24 13:02:52.593340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 208/426] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:52 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:53.609969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8dc13738-e6ae-4cc5-9157-a833015a0d7e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:53.610601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8dc13738-e6ae-4cc5-9157-a833015a0d7e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:53.616669 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dc13738-e6ae-4cc5-9157-a833015a0d7e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:53.617117 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dc13738-e6ae-4cc5-9157-a833015a0d7e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:53.617870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dc13738-e6ae-4cc5-9157-a833015a0d7e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:53.618311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dc13738-e6ae-4cc5-9157-a833015a0d7e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:53.749919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8dc13738-e6ae-4cc5-9157-a833015a0d7e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:53.758148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8dc13738-e6ae-4cc5-9157-a833015a0d7e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.152002 May 24 13:02:53.758736 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 219/427] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:53 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:54.774644 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dea9e18d-45b8-4da5-be14-6cb474fa7392 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:54.775299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dea9e18d-45b8-4da5-be14-6cb474fa7392 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:54.781706 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dea9e18d-45b8-4da5-be14-6cb474fa7392 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:54.782159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dea9e18d-45b8-4da5-be14-6cb474fa7392 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:54.782964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dea9e18d-45b8-4da5-be14-6cb474fa7392 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:54.783398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dea9e18d-45b8-4da5-be14-6cb474fa7392 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:54.908948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dea9e18d-45b8-4da5-be14-6cb474fa7392 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:54.917056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dea9e18d-45b8-4da5-be14-6cb474fa7392 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.146229 May 24 13:02:54.917617 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 209/428] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:54 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:55.933081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a8dd576b-ac93-47a5-a750-bc64f8a3f043 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:55.933646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a8dd576b-ac93-47a5-a750-bc64f8a3f043 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:55.939777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8dd576b-ac93-47a5-a750-bc64f8a3f043 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:55.940228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8dd576b-ac93-47a5-a750-bc64f8a3f043 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:55.940994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8dd576b-ac93-47a5-a750-bc64f8a3f043 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:55.941443 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8dd576b-ac93-47a5-a750-bc64f8a3f043 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:56.069023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a8dd576b-ac93-47a5-a750-bc64f8a3f043 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:56.076446 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a8dd576b-ac93-47a5-a750-bc64f8a3f043 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.147207 May 24 13:02:56.077012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 220/429] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:55 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:57.096616 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ac3b25b8-1ab8-43f0-bcef-a78268b318f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:57.097351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ac3b25b8-1ab8-43f0-bcef-a78268b318f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:57.104928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac3b25b8-1ab8-43f0-bcef-a78268b318f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:57.105505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac3b25b8-1ab8-43f0-bcef-a78268b318f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:57.106341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac3b25b8-1ab8-43f0-bcef-a78268b318f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:57.106839 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac3b25b8-1ab8-43f0-bcef-a78268b318f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:57.242133 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ac3b25b8-1ab8-43f0-bcef-a78268b318f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:57.251435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ac3b25b8-1ab8-43f0-bcef-a78268b318f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1522 microversion: 2.1 time: 0.159173 May 24 13:02:57.252068 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 210/430] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:57 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:58.271592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bf1b767c-310a-4f21-8c3e-2fcd56d82635 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:58.272216 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bf1b767c-310a-4f21-8c3e-2fcd56d82635 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:58.274164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=40 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:58.279383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bf1b767c-310a-4f21-8c3e-2fcd56d82635 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:58.279841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bf1b767c-310a-4f21-8c3e-2fcd56d82635 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:58.280623 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bf1b767c-310a-4f21-8c3e-2fcd56d82635 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:58.281093 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bf1b767c-310a-4f21-8c3e-2fcd56d82635 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:58.489995 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bf1b767c-310a-4f21-8c3e-2fcd56d82635 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:58.499209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bf1b767c-310a-4f21-8c3e-2fcd56d82635 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1502 microversion: 2.1 time: 0.232246 May 24 13:02:58.500046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 221/431] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:58 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:02:58.516237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-15442e00-c186-4923-b059-d1bc09497d61 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:02:58.517256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-15442e00-c186-4923-b059-d1bc09497d61 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:02:58.524114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15442e00-c186-4923-b059-d1bc09497d61 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:58.524771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15442e00-c186-4923-b059-d1bc09497d61 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:58.525711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15442e00-c186-4923-b059-d1bc09497d61 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:02:58.526314 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15442e00-c186-4923-b059-d1bc09497d61 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:02:58.676180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-15442e00-c186-4923-b059-d1bc09497d61 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:02:58.684374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-15442e00-c186-4923-b059-d1bc09497d61 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1515 microversion: 2.1 time: 0.172000 May 24 13:02:58.688879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 211/432] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:02:58 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:03.544132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-30037290-bf02-44c8-ae21-05c4d72a370b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:03.545947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-30037290-bf02-44c8-ae21-05c4d72a370b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:03.569209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30037290-bf02-44c8-ae21-05c4d72a370b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:03.569877 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30037290-bf02-44c8-ae21-05c4d72a370b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:03.572145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30037290-bf02-44c8-ae21-05c4d72a370b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:03.573164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30037290-bf02-44c8-ae21-05c4d72a370b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:03.601143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-30037290-bf02-44c8-ae21-05c4d72a370b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lazy-loading 'flavor' on Instance uuid ecfc07c6-54c6-40b9-83bb-0343afadb737 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:03:03.706536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-30037290-bf02-44c8-ae21-05c4d72a370b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737/action" status: 200 len: 32 microversion: 2.1 time: 0.166243 May 24 13:03:03.707841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 222/433] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:03:03 2022] POST /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 13:03:03.718846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a39b09e2-22b3-42f3-b827-f688509d5574 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:03.721296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a39b09e2-22b3-42f3-b827-f688509d5574 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:03.728905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a39b09e2-22b3-42f3-b827-f688509d5574 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:03.730177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a39b09e2-22b3-42f3-b827-f688509d5574 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:03.731354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a39b09e2-22b3-42f3-b827-f688509d5574 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:03.732666 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a39b09e2-22b3-42f3-b827-f688509d5574 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:03.973565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a39b09e2-22b3-42f3-b827-f688509d5574 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:03.981961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a39b09e2-22b3-42f3-b827-f688509d5574 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.268951 May 24 13:03:03.982761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 212/434] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:03 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:03:04.999613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-18ff6eaa-995b-4580-ad7b-a931e4a4c931 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:05.000326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-18ff6eaa-995b-4580-ad7b-a931e4a4c931 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:05.006877 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-18ff6eaa-995b-4580-ad7b-a931e4a4c931 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:05.007335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-18ff6eaa-995b-4580-ad7b-a931e4a4c931 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:05.008120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-18ff6eaa-995b-4580-ad7b-a931e4a4c931 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:05.008554 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-18ff6eaa-995b-4580-ad7b-a931e4a4c931 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:05.307529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-18ff6eaa-995b-4580-ad7b-a931e4a4c931 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:05.324125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-18ff6eaa-995b-4580-ad7b-a931e4a4c931 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.328206 May 24 13:03:05.327227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 223/435] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:04 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:06.346478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3fc432de-d5e7-44e0-b775-dc6a6549c221 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:06.348310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3fc432de-d5e7-44e0-b775-dc6a6549c221 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:06.392626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3fc432de-d5e7-44e0-b775-dc6a6549c221 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:06.395411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3fc432de-d5e7-44e0-b775-dc6a6549c221 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:06.397588 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3fc432de-d5e7-44e0-b775-dc6a6549c221 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:06.404458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3fc432de-d5e7-44e0-b775-dc6a6549c221 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:06.424402 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=96 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:06.727076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3fc432de-d5e7-44e0-b775-dc6a6549c221 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:06.736582 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3fc432de-d5e7-44e0-b775-dc6a6549c221 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.396643 May 24 13:03:06.739395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 213/436] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:06 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:07.761167 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2fb12eaf-56c8-45a9-84e2-1052dcd171d4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:07.763158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2fb12eaf-56c8-45a9-84e2-1052dcd171d4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:07.778605 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fb12eaf-56c8-45a9-84e2-1052dcd171d4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:07.779707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fb12eaf-56c8-45a9-84e2-1052dcd171d4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:07.780767 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fb12eaf-56c8-45a9-84e2-1052dcd171d4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:07.781612 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fb12eaf-56c8-45a9-84e2-1052dcd171d4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:08.047458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2fb12eaf-56c8-45a9-84e2-1052dcd171d4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:08.076778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2fb12eaf-56c8-45a9-84e2-1052dcd171d4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.323499 May 24 13:03:08.091363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 224/437] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:07 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:09.099520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cec4c464-4e89-4e41-bfdf-b704e9141cad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:09.100432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cec4c464-4e89-4e41-bfdf-b704e9141cad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:09.107570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cec4c464-4e89-4e41-bfdf-b704e9141cad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:09.108159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cec4c464-4e89-4e41-bfdf-b704e9141cad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:09.109049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cec4c464-4e89-4e41-bfdf-b704e9141cad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:09.109629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cec4c464-4e89-4e41-bfdf-b704e9141cad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:09.278261 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cec4c464-4e89-4e41-bfdf-b704e9141cad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:09.288160 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cec4c464-4e89-4e41-bfdf-b704e9141cad tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.193192 May 24 13:03:09.294405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 214/438] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:09 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:10.311476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ebe08615-df43-4c06-a736-816bf7e7cc97 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:10.312825 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ebe08615-df43-4c06-a736-816bf7e7cc97 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:10.326674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebe08615-df43-4c06-a736-816bf7e7cc97 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:10.327301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebe08615-df43-4c06-a736-816bf7e7cc97 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:10.328236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebe08615-df43-4c06-a736-816bf7e7cc97 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:10.337161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebe08615-df43-4c06-a736-816bf7e7cc97 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:10.522299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ebe08615-df43-4c06-a736-816bf7e7cc97 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:10.532856 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ebe08615-df43-4c06-a736-816bf7e7cc97 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.231268 May 24 13:03:10.533995 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 225/439] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:10 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:11.552829 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c61ddc01-52ce-4020-95e3-04d393a2ca53 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:11.553719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c61ddc01-52ce-4020-95e3-04d393a2ca53 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:11.565822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c61ddc01-52ce-4020-95e3-04d393a2ca53 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:11.566095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c61ddc01-52ce-4020-95e3-04d393a2ca53 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:11.567375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c61ddc01-52ce-4020-95e3-04d393a2ca53 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:11.567819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c61ddc01-52ce-4020-95e3-04d393a2ca53 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:11.839719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c61ddc01-52ce-4020-95e3-04d393a2ca53 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:11.854751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c61ddc01-52ce-4020-95e3-04d393a2ca53 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.306373 May 24 13:03:11.856322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 215/440] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:11 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:12.876133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cca0aa7c-ca2c-4023-94d4-694aef57ac13 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:12.878133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cca0aa7c-ca2c-4023-94d4-694aef57ac13 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:12.898003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cca0aa7c-ca2c-4023-94d4-694aef57ac13 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:12.898788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cca0aa7c-ca2c-4023-94d4-694aef57ac13 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:12.899946 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cca0aa7c-ca2c-4023-94d4-694aef57ac13 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:12.900591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cca0aa7c-ca2c-4023-94d4-694aef57ac13 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:13.199942 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cca0aa7c-ca2c-4023-94d4-694aef57ac13 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:13.210082 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cca0aa7c-ca2c-4023-94d4-694aef57ac13 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.337811 May 24 13:03:13.221137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 226/441] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:12 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:14.234376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bb2e39a9-e2f4-4231-873c-7fdfddb476cf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:14.235182 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bb2e39a9-e2f4-4231-873c-7fdfddb476cf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:14.254866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb2e39a9-e2f4-4231-873c-7fdfddb476cf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:14.255514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb2e39a9-e2f4-4231-873c-7fdfddb476cf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:14.257420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb2e39a9-e2f4-4231-873c-7fdfddb476cf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:14.258881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb2e39a9-e2f4-4231-873c-7fdfddb476cf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:14.604565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bb2e39a9-e2f4-4231-873c-7fdfddb476cf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:14.620056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bb2e39a9-e2f4-4231-873c-7fdfddb476cf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.391500 May 24 13:03:14.620668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 216/442] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:14 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:15.639173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-41df8884-f4fb-48f1-8ed3-59bc807e9129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:15.640514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-41df8884-f4fb-48f1-8ed3-59bc807e9129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:15.648096 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-41df8884-f4fb-48f1-8ed3-59bc807e9129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:15.648924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-41df8884-f4fb-48f1-8ed3-59bc807e9129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:15.649999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-41df8884-f4fb-48f1-8ed3-59bc807e9129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:15.650683 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-41df8884-f4fb-48f1-8ed3-59bc807e9129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:15.875443 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-41df8884-f4fb-48f1-8ed3-59bc807e9129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:15.884764 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-41df8884-f4fb-48f1-8ed3-59bc807e9129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.250562 May 24 13:03:15.885865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 227/443] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:15 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:16.904278 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fd46653e-bb25-4015-9d7c-7adaa0bf7fae tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:16.905198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fd46653e-bb25-4015-9d7c-7adaa0bf7fae tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:16.910249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=24 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:16.924439 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd46653e-bb25-4015-9d7c-7adaa0bf7fae tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:16.925225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd46653e-bb25-4015-9d7c-7adaa0bf7fae tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:16.927278 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd46653e-bb25-4015-9d7c-7adaa0bf7fae tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:16.927846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd46653e-bb25-4015-9d7c-7adaa0bf7fae tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:17.255493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fd46653e-bb25-4015-9d7c-7adaa0bf7fae tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:17.266974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fd46653e-bb25-4015-9d7c-7adaa0bf7fae tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.367325 May 24 13:03:17.270117 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 217/444] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:16 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:18.289406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6f35c704-e48d-4cbd-9caa-e21a89e7b2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:18.292136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6f35c704-e48d-4cbd-9caa-e21a89e7b2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:18.304102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f35c704-e48d-4cbd-9caa-e21a89e7b2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:18.304863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f35c704-e48d-4cbd-9caa-e21a89e7b2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:18.306144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f35c704-e48d-4cbd-9caa-e21a89e7b2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:18.306829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f35c704-e48d-4cbd-9caa-e21a89e7b2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:18.603023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6f35c704-e48d-4cbd-9caa-e21a89e7b2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:18.613348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6f35c704-e48d-4cbd-9caa-e21a89e7b2ac tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.331465 May 24 13:03:18.624200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 228/445] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:18 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:19.631535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7294c404-56ee-4676-aa5f-c68889eb7d55 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:19.631983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7294c404-56ee-4676-aa5f-c68889eb7d55 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:19.654399 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7294c404-56ee-4676-aa5f-c68889eb7d55 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:19.654881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7294c404-56ee-4676-aa5f-c68889eb7d55 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:19.663812 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7294c404-56ee-4676-aa5f-c68889eb7d55 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:19.664359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7294c404-56ee-4676-aa5f-c68889eb7d55 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:20.354177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7294c404-56ee-4676-aa5f-c68889eb7d55 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:20.362585 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7294c404-56ee-4676-aa5f-c68889eb7d55 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1501 microversion: 2.1 time: 0.735954 May 24 13:03:20.367400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 218/446] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:19 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1501 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:20.388880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a71d2b2d-9b3b-4572-8968-4c6ac9bedf62"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:20.391482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:20.405306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:20.405765 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:20.406581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:20.407020 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:20.499744 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] HTTP exception thrown: Cannot 'attach_volume' instance ecfc07c6-54c6-40b9-83bb-0343afadb737 while it is in vm_state rescued May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Request method failure captured: May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: POST /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737/os-volume_attachments HTTP/1.1 May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 74 May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbk1m2T0FVB_cowxlzFZQfSHOpRVI9qCWVHjb_tithLQX15Ze6FudOun7uaWC1WgdzOGlkCCMv9N7uEpRLg0FHpv0Qtqjx_79FscW-065fahLrq7wPXW2IVrIkFc2ISrVCiR1ErbpQ1shxRRVCO35nu5BuuLWvvWyK8OB9kj9ByHGI May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:03:20.515097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 91a76f7af8a5467bbf567ca5b9db9ce0 May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {"volumeAttachment": {"volumeId": "a71d2b2d-9b3b-4572-8968-4c6ac9bedf62"}} May 24 13:03:20.516819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Cannot 'attach_volume' instance ecfc07c6-54c6-40b9-83bb-0343afadb737 while it is in vm_state rescued May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'server_id': 'ecfc07c6-54c6-40b9-83bb-0343afadb737', 'body': {'volumeAttachment': {'volumeId': 'a71d2b2d-9b3b-4572-8968-4c6ac9bedf62'}}} May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ecfc07c6-54c6-40b9-83bb-0343afadb737 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:03:20.517640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ecfc07c6-54c6-40b9-83bb-0343afadb737 while it is in vm_state rescued May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:03:20.518813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:03:20.519940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:03:20.519940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:03:20.519940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ecfc07c6-54c6-40b9-83bb-0343afadb737 while it is in vm_state rescued May 24 13:03:20.519940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:03:20.529837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Returning 409 to user: Cannot 'attach_volume' instance ecfc07c6-54c6-40b9-83bb-0343afadb737 while it is in vm_state rescued {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:03:20.531050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5a72e715-aa87-4370-9f93-dce02dd1db20 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.146782 May 24 13:03:20.531824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 229/447] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 13:03:20 2022] POST /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737/os-volume_attachments => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 13:03:20.541784 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9961cb4d-2b93-4bd9-9b83-7e9f6da0b790 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:20.542694 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9961cb4d-2b93-4bd9-9b83-7e9f6da0b790 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:20.552737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9961cb4d-2b93-4bd9-9b83-7e9f6da0b790 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:20.553523 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9961cb4d-2b93-4bd9-9b83-7e9f6da0b790 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:20.555156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9961cb4d-2b93-4bd9-9b83-7e9f6da0b790 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:20.566486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9961cb4d-2b93-4bd9-9b83-7e9f6da0b790 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:20.760514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9961cb4d-2b93-4bd9-9b83-7e9f6da0b790 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737/action" status: 202 len: 0 microversion: 2.1 time: 0.223162 May 24 13:03:20.774489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-51079efe-b62d-44fc-857e-98d020567e46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:20.774489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-51079efe-b62d-44fc-857e-98d020567e46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:20.777402 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 219/448] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:03:20 2022] POST /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 13:03:20.782740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-51079efe-b62d-44fc-857e-98d020567e46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:20.783438 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-51079efe-b62d-44fc-857e-98d020567e46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:20.785258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-51079efe-b62d-44fc-857e-98d020567e46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:20.790163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-51079efe-b62d-44fc-857e-98d020567e46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:21.065361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-51079efe-b62d-44fc-857e-98d020567e46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:21.078317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-51079efe-b62d-44fc-857e-98d020567e46 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1509 microversion: 2.1 time: 0.312689 May 24 13:03:21.079645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 230/449] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:20 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:22.119889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-86258444-4bc8-481f-b366-32bb9695cf29 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:22.120830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-86258444-4bc8-481f-b366-32bb9695cf29 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:22.144325 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86258444-4bc8-481f-b366-32bb9695cf29 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:22.155609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86258444-4bc8-481f-b366-32bb9695cf29 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:22.156810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86258444-4bc8-481f-b366-32bb9695cf29 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:22.157491 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86258444-4bc8-481f-b366-32bb9695cf29 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:22.507604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-86258444-4bc8-481f-b366-32bb9695cf29 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:22.533623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-86258444-4bc8-481f-b366-32bb9695cf29 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1509 microversion: 2.1 time: 0.439913 May 24 13:03:22.537496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 220/450] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:22 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1509 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:23.554897 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-39c3e79d-9ce0-4981-8c31-286b62b5fa78 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:23.556719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-39c3e79d-9ce0-4981-8c31-286b62b5fa78 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:23.570713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39c3e79d-9ce0-4981-8c31-286b62b5fa78 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:23.571696 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39c3e79d-9ce0-4981-8c31-286b62b5fa78 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:23.573003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39c3e79d-9ce0-4981-8c31-286b62b5fa78 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:23.573722 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39c3e79d-9ce0-4981-8c31-286b62b5fa78 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:23.774156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-39c3e79d-9ce0-4981-8c31-286b62b5fa78 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:23.785555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-39c3e79d-9ce0-4981-8c31-286b62b5fa78 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1509 microversion: 2.1 time: 0.234960 May 24 13:03:23.786398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 221/451] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:23 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:03:23.839319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e18ced86-3f20-4064-afbc-d04c372d1ccd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Action: 'create', calling method: .version_select at 0x7f9a66014af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1349995211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYW9rYkw9SDYjDC8cCmOtpQJxw7a6hFYqHzvcEv0Hd5WmmRV3GOgp0JASLQiB7BHgfobpl81cZwl62iBZCz4Kll8MOvWXqW4IF/H/6zs5djnmy9lzDU2DQ9sG1OnQNYSw=="}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:23.842700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-e18ced86-3f20-4064-afbc-d04c372d1ccd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Getting quotas for project b20159be9d404dd2812ffeffe055ec67. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:03:23.847663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-e18ced86-3f20-4064-afbc-d04c372d1ccd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Getting quotas for user d87d9358c42a43fea94927869c44dc82 and project b20159be9d404dd2812ffeffe055ec67. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:03:23.861893 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e18ced86-3f20-4064-afbc-d04c372d1ccd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [d7a05e89-1dca-4e52-8341-21ada64bd0e9] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 13:03:24.806937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-343fe4a0-24b6-4cd4-9742-61e19772ef19 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:24.807542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-343fe4a0-24b6-4cd4-9742-61e19772ef19 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:24.813940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-343fe4a0-24b6-4cd4-9742-61e19772ef19 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:24.814433 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-343fe4a0-24b6-4cd4-9742-61e19772ef19 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:24.815189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-343fe4a0-24b6-4cd4-9742-61e19772ef19 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:24.815625 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-343fe4a0-24b6-4cd4-9742-61e19772ef19 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:24.869923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [None req-e18ced86-3f20-4064-afbc-d04c372d1ccd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [d7a05e89-1dca-4e52-8341-21ada64bd0e9] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 58504. May 24 13:03:24.886775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e18ced86-3f20-4064-afbc-d04c372d1ccd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.385132 May 24 13:03:24.887747 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 231/452] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 13:03:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:03:24.963591 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-343fe4a0-24b6-4cd4-9742-61e19772ef19 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:24.973354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-343fe4a0-24b6-4cd4-9742-61e19772ef19 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1515 microversion: 2.1 time: 0.170151 May 24 13:03:24.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 222/453] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:24 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:03:26.519560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5c5956e7-609b-4066-8306-f52ae2e164db tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'create', calling method: .version_select at 0x7f9a6609de50>, body: {"keypair": {"name": "tempest-keypair-1250656988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy0jNmYkgUmneWd9Ic4pFz1Lxlu8Oj3QCFYs6vEoUY12MO4+aneHR3UFzIzqNsrfSREgxvDNT3SKgp+6CNvqcH5IsW6eROrZd0182dMe4tSMldCOI6wZeJzPYLAaCgqkQ=="}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:26.541488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-5c5956e7-609b-4066-8306-f52ae2e164db tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Getting quotas for project a92196ee4d214c999d303c7f8e28a9ce. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:03:26.546524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-5c5956e7-609b-4066-8306-f52ae2e164db tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Getting quotas for user 91a76f7af8a5467bbf567ca5b9db9ce0 and project a92196ee4d214c999d303c7f8e28a9ce. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:03:26.579059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5c5956e7-609b-4066-8306-f52ae2e164db tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065436 May 24 13:03:26.580944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 232/454] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 13:03:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:03:28.293308 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2048595572", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbcecfd4-b0fe-4041-9185-a83b5cc7e769"}], "security_groups": [{"name": "tempest-securitygroup--202638941"}], "key_name": "tempest-keypair-1250656988", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:28.424730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] validate_networks() for [('bbcecfd4-b0fe-4041-9185-a83b5cc7e769', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:03:28.841326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:03:28.841754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:03:28.842409 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:03:28.842876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:03:28.843322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:03:28.854546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:28.855071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:28.855942 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:28.856447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:28.875521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Getting quotas for project a92196ee4d214c999d303c7f8e28a9ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:03:28.880125 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Getting quotas for user 91a76f7af8a5467bbf567ca5b9db9ce0 and project a92196ee4d214c999d303c7f8e28a9ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:03:28.899651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:03:28.901937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:03:28.950830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-645f7ee3-16de-4d9f-b287-5f80eea07984 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.661527 May 24 13:03:28.956323 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 223/455] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:03:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:03:28.961327 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fbe3bc30-b838-4bd1-bd80-22327a4576d3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:28.961963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fbe3bc30-b838-4bd1-bd80-22327a4576d3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:28.965019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:29.042720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-fbe3bc30-b838-4bd1-bd80-22327a4576d3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:29.050319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fbe3bc30-b838-4bd1-bd80-22327a4576d3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1246 microversion: 2.1 time: 0.092739 May 24 13:03:29.051385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 233/456] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:28 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:03:30.070143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7a3e64b9-890d-4034-9a71-e7cb47e60d0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:30.071403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7a3e64b9-890d-4034-9a71-e7cb47e60d0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:30.079760 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a3e64b9-890d-4034-9a71-e7cb47e60d0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:30.080477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a3e64b9-890d-4034-9a71-e7cb47e60d0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:30.081969 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a3e64b9-890d-4034-9a71-e7cb47e60d0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:30.082614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a3e64b9-890d-4034-9a71-e7cb47e60d0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:30.180652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7a3e64b9-890d-4034-9a71-e7cb47e60d0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:30.188241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7a3e64b9-890d-4034-9a71-e7cb47e60d0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1304 microversion: 2.1 time: 0.123911 May 24 13:03:30.188870 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 224/457] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:30 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:31.208585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d47cda84-29c6-4252-acb7-69ee09914a0c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:31.209829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d47cda84-29c6-4252-acb7-69ee09914a0c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:31.212646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:31.218642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d47cda84-29c6-4252-acb7-69ee09914a0c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:31.219101 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d47cda84-29c6-4252-acb7-69ee09914a0c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:31.219907 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d47cda84-29c6-4252-acb7-69ee09914a0c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:31.220730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d47cda84-29c6-4252-acb7-69ee09914a0c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:31.374755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d47cda84-29c6-4252-acb7-69ee09914a0c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:31.383132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d47cda84-29c6-4252-acb7-69ee09914a0c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.181941 May 24 13:03:31.384282 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 234/458] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:31 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:31.461322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-0e851ba2-3ddc-4531-8c0a-4f94438dc6dc req-03dedcfe-7a0d-4c86-8004-a2a2595a25aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968b8af5-f426-4c06-bf8a-fd06bc9e71d7", "tag": "98ea03b5-b5f4-4953-9488-c61cc24f6125"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:31.477104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-0e851ba2-3ddc-4531-8c0a-4f94438dc6dc req-03dedcfe-7a0d-4c86-8004-a2a2595a25aa service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:31.478004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-0e851ba2-3ddc-4531-8c0a-4f94438dc6dc req-03dedcfe-7a0d-4c86-8004-a2a2595a25aa service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:31.492916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-0e851ba2-3ddc-4531-8c0a-4f94438dc6dc req-03dedcfe-7a0d-4c86-8004-a2a2595a25aa service nova] Creating event network-changed:98ea03b5-b5f4-4953-9488-c61cc24f6125 for instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 on hv-cinder-84301 May 24 13:03:31.502615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-0e851ba2-3ddc-4531-8c0a-4f94438dc6dc req-03dedcfe-7a0d-4c86-8004-a2a2595a25aa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044559 May 24 13:03:31.505006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 225/459] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:03:32.399950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ad7e6b3e-596e-402a-931a-2d6c47f4be5a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:32.400618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ad7e6b3e-596e-402a-931a-2d6c47f4be5a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:32.406620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad7e6b3e-596e-402a-931a-2d6c47f4be5a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:32.407081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad7e6b3e-596e-402a-931a-2d6c47f4be5a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:32.408024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad7e6b3e-596e-402a-931a-2d6c47f4be5a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:32.408455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad7e6b3e-596e-402a-931a-2d6c47f4be5a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:32.549785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ad7e6b3e-596e-402a-931a-2d6c47f4be5a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:32.558454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ad7e6b3e-596e-402a-931a-2d6c47f4be5a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.162186 May 24 13:03:32.559031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 235/460] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:32 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:33.576172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-94c3868b-7ddb-4803-8315-1933a3f6f5f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:33.576878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-94c3868b-7ddb-4803-8315-1933a3f6f5f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:33.583836 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-94c3868b-7ddb-4803-8315-1933a3f6f5f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:33.584292 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-94c3868b-7ddb-4803-8315-1933a3f6f5f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:33.585415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-94c3868b-7ddb-4803-8315-1933a3f6f5f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:33.585869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-94c3868b-7ddb-4803-8315-1933a3f6f5f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:33.717531 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-94c3868b-7ddb-4803-8315-1933a3f6f5f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:33.725012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-94c3868b-7ddb-4803-8315-1933a3f6f5f7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.153496 May 24 13:03:33.725577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 226/461] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:33 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:34.742452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b5bdedf7-221c-4f0f-9047-ef8bda9ff23c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:34.743238 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b5bdedf7-221c-4f0f-9047-ef8bda9ff23c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:34.750028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5bdedf7-221c-4f0f-9047-ef8bda9ff23c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:34.750535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5bdedf7-221c-4f0f-9047-ef8bda9ff23c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:34.751314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5bdedf7-221c-4f0f-9047-ef8bda9ff23c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:34.751748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5bdedf7-221c-4f0f-9047-ef8bda9ff23c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:34.887524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b5bdedf7-221c-4f0f-9047-ef8bda9ff23c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:34.895453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b5bdedf7-221c-4f0f-9047-ef8bda9ff23c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.157461 May 24 13:03:34.896011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 236/462] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:34 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:35.912668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0f58d3f2-c3b5-44ed-94c6-1732b6991baf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:35.913268 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0f58d3f2-c3b5-44ed-94c6-1732b6991baf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:35.919806 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f58d3f2-c3b5-44ed-94c6-1732b6991baf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:35.920260 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f58d3f2-c3b5-44ed-94c6-1732b6991baf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:35.921026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f58d3f2-c3b5-44ed-94c6-1732b6991baf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:35.921465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f58d3f2-c3b5-44ed-94c6-1732b6991baf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:36.057660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0f58d3f2-c3b5-44ed-94c6-1732b6991baf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:36.065121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0f58d3f2-c3b5-44ed-94c6-1732b6991baf tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.157049 May 24 13:03:36.065686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 227/463] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:35 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:37.081595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8491b55c-6792-4d35-a65e-916b706c913a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:37.082204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8491b55c-6792-4d35-a65e-916b706c913a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:37.088359 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8491b55c-6792-4d35-a65e-916b706c913a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:37.088809 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8491b55c-6792-4d35-a65e-916b706c913a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:37.089627 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8491b55c-6792-4d35-a65e-916b706c913a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:37.090104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8491b55c-6792-4d35-a65e-916b706c913a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:37.224821 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8491b55c-6792-4d35-a65e-916b706c913a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:37.232275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8491b55c-6792-4d35-a65e-916b706c913a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.154530 May 24 13:03:37.232831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 237/464] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:37 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:38.249111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d41745a2-bab1-439b-9c51-430406cceb8a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:38.249722 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d41745a2-bab1-439b-9c51-430406cceb8a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:38.257044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d41745a2-bab1-439b-9c51-430406cceb8a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:38.257527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d41745a2-bab1-439b-9c51-430406cceb8a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:38.258312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d41745a2-bab1-439b-9c51-430406cceb8a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:38.258748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d41745a2-bab1-439b-9c51-430406cceb8a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:38.262836 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:38.390926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d41745a2-bab1-439b-9c51-430406cceb8a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:38.398475 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d41745a2-bab1-439b-9c51-430406cceb8a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.153178 May 24 13:03:38.399088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 228/465] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:38 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:39.416365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-66898041-45d2-4208-adb6-0b6a9e8eb193 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:39.417013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-66898041-45d2-4208-adb6-0b6a9e8eb193 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:39.419005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=10 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:39.424690 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66898041-45d2-4208-adb6-0b6a9e8eb193 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:39.425724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66898041-45d2-4208-adb6-0b6a9e8eb193 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:39.426544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66898041-45d2-4208-adb6-0b6a9e8eb193 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:39.426983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66898041-45d2-4208-adb6-0b6a9e8eb193 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:39.564152 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-66898041-45d2-4208-adb6-0b6a9e8eb193 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:39.571842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-66898041-45d2-4208-adb6-0b6a9e8eb193 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.159417 May 24 13:03:39.572562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 238/466] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:39 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:39.956042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:03:39.956814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:03:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:03:40.589120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7070f884-c170-42e2-b78d-cd1a8486051d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:40.589781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7070f884-c170-42e2-b78d-cd1a8486051d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:40.591668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:40.592325 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:40.599415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070f884-c170-42e2-b78d-cd1a8486051d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:40.599865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070f884-c170-42e2-b78d-cd1a8486051d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:40.600633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070f884-c170-42e2-b78d-cd1a8486051d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:40.601073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070f884-c170-42e2-b78d-cd1a8486051d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:40.735886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7070f884-c170-42e2-b78d-cd1a8486051d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:40.744132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7070f884-c170-42e2-b78d-cd1a8486051d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.158947 May 24 13:03:40.744694 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 229/467] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:40 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:41.760724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dc35ba8e-bbcd-4a40-94e9-b64df761a7a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:41.761325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dc35ba8e-bbcd-4a40-94e9-b64df761a7a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:41.767403 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc35ba8e-bbcd-4a40-94e9-b64df761a7a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:41.767845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc35ba8e-bbcd-4a40-94e9-b64df761a7a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:41.768628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc35ba8e-bbcd-4a40-94e9-b64df761a7a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:41.769057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc35ba8e-bbcd-4a40-94e9-b64df761a7a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:41.907616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dc35ba8e-bbcd-4a40-94e9-b64df761a7a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:41.915116 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dc35ba8e-bbcd-4a40-94e9-b64df761a7a0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.158238 May 24 13:03:41.915679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 239/468] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:41 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:42.931976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-144c0247-1dd6-4a28-a39f-e469b38fda0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:42.932584 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-144c0247-1dd6-4a28-a39f-e469b38fda0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:42.939108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-144c0247-1dd6-4a28-a39f-e469b38fda0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:42.939550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-144c0247-1dd6-4a28-a39f-e469b38fda0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:42.940807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-144c0247-1dd6-4a28-a39f-e469b38fda0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:42.941235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-144c0247-1dd6-4a28-a39f-e469b38fda0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:43.069396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-144c0247-1dd6-4a28-a39f-e469b38fda0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:43.076844 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-144c0247-1dd6-4a28-a39f-e469b38fda0a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.148713 May 24 13:03:43.077403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 230/469] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:42 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:44.093862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-131bd414-69e3-4bde-8fb4-9d7d6cf627de tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:44.094525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-131bd414-69e3-4bde-8fb4-9d7d6cf627de tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:44.101271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-131bd414-69e3-4bde-8fb4-9d7d6cf627de tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:44.101726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-131bd414-69e3-4bde-8fb4-9d7d6cf627de tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:44.102532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-131bd414-69e3-4bde-8fb4-9d7d6cf627de tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:44.102974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-131bd414-69e3-4bde-8fb4-9d7d6cf627de tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:44.234800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-131bd414-69e3-4bde-8fb4-9d7d6cf627de tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:44.246000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-131bd414-69e3-4bde-8fb4-9d7d6cf627de tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.156059 May 24 13:03:44.246645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 240/470] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:44 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:45.262441 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-175d3b53-88e9-4e12-a8a6-1cc0ddb254b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:45.262987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-175d3b53-88e9-4e12-a8a6-1cc0ddb254b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:45.269451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-175d3b53-88e9-4e12-a8a6-1cc0ddb254b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:45.269894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-175d3b53-88e9-4e12-a8a6-1cc0ddb254b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:45.270734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-175d3b53-88e9-4e12-a8a6-1cc0ddb254b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:45.271307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-175d3b53-88e9-4e12-a8a6-1cc0ddb254b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:45.399041 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-175d3b53-88e9-4e12-a8a6-1cc0ddb254b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:45.406770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-175d3b53-88e9-4e12-a8a6-1cc0ddb254b1 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.148010 May 24 13:03:45.407220 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 231/471] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:45 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:46.423196 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9328cf08-5950-447f-8851-1bd34717d82e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:46.423816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9328cf08-5950-447f-8851-1bd34717d82e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:46.429769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9328cf08-5950-447f-8851-1bd34717d82e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:46.430222 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9328cf08-5950-447f-8851-1bd34717d82e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:46.431015 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9328cf08-5950-447f-8851-1bd34717d82e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:46.431452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9328cf08-5950-447f-8851-1bd34717d82e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:46.555580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9328cf08-5950-447f-8851-1bd34717d82e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:46.563057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9328cf08-5950-447f-8851-1bd34717d82e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.143734 May 24 13:03:46.563864 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 241/472] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:46 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:47.578657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8e0211f0-0fb6-4c3f-b321-deda825a9336 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:47.579274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8e0211f0-0fb6-4c3f-b321-deda825a9336 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:47.581604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:47.587548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e0211f0-0fb6-4c3f-b321-deda825a9336 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:47.587997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e0211f0-0fb6-4c3f-b321-deda825a9336 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:47.588762 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e0211f0-0fb6-4c3f-b321-deda825a9336 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:47.589200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e0211f0-0fb6-4c3f-b321-deda825a9336 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:47.722247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8e0211f0-0fb6-4c3f-b321-deda825a9336 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:47.730183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8e0211f0-0fb6-4c3f-b321-deda825a9336 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.155345 May 24 13:03:47.740034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 232/473] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:47 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:47.772797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-35e9c175-407c-4c40-8f70-69c33d7104fd req-ce10da1b-2181-4eda-b90c-afbfe8697c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968b8af5-f426-4c06-bf8a-fd06bc9e71d7", "name": "network-vif-plugged", "status": "completed", "tag": "98ea03b5-b5f4-4953-9488-c61cc24f6125"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:47.782086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-35e9c175-407c-4c40-8f70-69c33d7104fd req-ce10da1b-2181-4eda-b90c-afbfe8697c67 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:47.783181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-35e9c175-407c-4c40-8f70-69c33d7104fd req-ce10da1b-2181-4eda-b90c-afbfe8697c67 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:47.795420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-35e9c175-407c-4c40-8f70-69c33d7104fd req-ce10da1b-2181-4eda-b90c-afbfe8697c67 service nova] Creating event network-vif-plugged:98ea03b5-b5f4-4953-9488-c61cc24f6125 for instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 on hv-cinder-84301 May 24 13:03:47.801069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-35e9c175-407c-4c40-8f70-69c33d7104fd req-ce10da1b-2181-4eda-b90c-afbfe8697c67 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031725 May 24 13:03:47.801649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 242/474] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:03:48.747774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d63e8141-0184-45f0-8549-f3bd966e2637 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:48.748387 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d63e8141-0184-45f0-8549-f3bd966e2637 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:48.755311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d63e8141-0184-45f0-8549-f3bd966e2637 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:48.755757 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d63e8141-0184-45f0-8549-f3bd966e2637 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:48.756514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d63e8141-0184-45f0-8549-f3bd966e2637 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:48.756948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d63e8141-0184-45f0-8549-f3bd966e2637 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:48.886522 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d63e8141-0184-45f0-8549-f3bd966e2637 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:48.894501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d63e8141-0184-45f0-8549-f3bd966e2637 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.150546 May 24 13:03:48.895055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 233/475] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:48 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:49.912006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ca3b9b5c-ffb8-4e7d-b54e-77643d956430 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:49.912700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ca3b9b5c-ffb8-4e7d-b54e-77643d956430 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:49.918982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ca3b9b5c-ffb8-4e7d-b54e-77643d956430 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:49.919518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ca3b9b5c-ffb8-4e7d-b54e-77643d956430 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:49.920270 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ca3b9b5c-ffb8-4e7d-b54e-77643d956430 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:49.920701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ca3b9b5c-ffb8-4e7d-b54e-77643d956430 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:50.057079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ca3b9b5c-ffb8-4e7d-b54e-77643d956430 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:50.064503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ca3b9b5c-ffb8-4e7d-b54e-77643d956430 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1371 microversion: 2.1 time: 0.157255 May 24 13:03:50.065592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 243/476] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:49 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:51.081275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bb5112a1-7519-4496-9205-ccfbb3bacb76 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:51.081892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bb5112a1-7519-4496-9205-ccfbb3bacb76 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:51.088577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb5112a1-7519-4496-9205-ccfbb3bacb76 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:51.089030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb5112a1-7519-4496-9205-ccfbb3bacb76 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:51.089828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb5112a1-7519-4496-9205-ccfbb3bacb76 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:51.090267 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb5112a1-7519-4496-9205-ccfbb3bacb76 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:51.213547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bb5112a1-7519-4496-9205-ccfbb3bacb76 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:51.221023 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bb5112a1-7519-4496-9205-ccfbb3bacb76 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1566 microversion: 2.1 time: 0.143568 May 24 13:03:51.222234 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 234/477] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:51 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1566 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:51.237717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dabff4bf-ef4a-454c-adca-3cd6a245cc92 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:51.238272 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dabff4bf-ef4a-454c-adca-3cd6a245cc92 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:51.244649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dabff4bf-ef4a-454c-adca-3cd6a245cc92 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:51.245092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dabff4bf-ef4a-454c-adca-3cd6a245cc92 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:51.245967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dabff4bf-ef4a-454c-adca-3cd6a245cc92 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:51.246609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dabff4bf-ef4a-454c-adca-3cd6a245cc92 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:51.321401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dabff4bf-ef4a-454c-adca-3cd6a245cc92 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087613 May 24 13:03:51.322128 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 244/478] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 13:03:51 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:03:52.449139 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-333eae4a-1b69-4e22-ad20-345e9bfb2872 req-41a5b1ad-b0cb-4e74-b40d-2578e0266fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968b8af5-f426-4c06-bf8a-fd06bc9e71d7", "tag": "98ea03b5-b5f4-4953-9488-c61cc24f6125"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:52.457592 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-333eae4a-1b69-4e22-ad20-345e9bfb2872 req-41a5b1ad-b0cb-4e74-b40d-2578e0266fac service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:52.458108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-333eae4a-1b69-4e22-ad20-345e9bfb2872 req-41a5b1ad-b0cb-4e74-b40d-2578e0266fac service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:52.469277 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-333eae4a-1b69-4e22-ad20-345e9bfb2872 req-41a5b1ad-b0cb-4e74-b40d-2578e0266fac service nova] Creating event network-changed:98ea03b5-b5f4-4953-9488-c61cc24f6125 for instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 on hv-cinder-84301 May 24 13:03:52.475287 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-333eae4a-1b69-4e22-ad20-345e9bfb2872 req-41a5b1ad-b0cb-4e74-b40d-2578e0266fac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029641 May 24 13:03:52.475880 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 235/479] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:03:55.238045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-573751806", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1349995211", "security_groups": [{"name": "tempest-secgroup-smoke-1538200982"}], "block_device_mapping_v2": [{"uuid": "35f15854-5770-45a6-881f-968f36db73eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac3b194e-d24e-420f-9232-298d2ecfb486"}]}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:55.345819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.network.neutron [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] validate_networks() for [('ac3b194e-d24e-420f-9232-298d2ecfb486', None, None, None, None, None)] {{(pid=117643) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:03:55.701609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Flavor limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:03:55.702030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Image limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:03:55.702543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Flavor pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:03:55.702952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Image pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:03:55.703362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:03:55.712165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:55.712614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:55.713409 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:55.713848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:55.730797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Getting quotas for project b20159be9d404dd2812ffeffe055ec67. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:03:55.734715 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Getting quotas for user d87d9358c42a43fea94927869c44dc82 and project b20159be9d404dd2812ffeffe055ec67. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:03:55.790505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Going to run 1 instances... {{(pid=117643) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:03:55.792623 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35f15854-5770-45a6-881f-968f36db73eb',volume_size=None,volume_type=None)] {{(pid=117643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:03:55.922981 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bb8578bf-a06b-4835-ae74-17a78a1a73f5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688717 May 24 13:03:55.923618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 245/480] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:03:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:03:55.934966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fc6e0bec-bc35-46f2-810a-656206e1c27e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:55.935672 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fc6e0bec-bc35-46f2-810a-656206e1c27e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:55.992410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fc6e0bec-bc35-46f2-810a-656206e1c27e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:55.999802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fc6e0bec-bc35-46f2-810a-656206e1c27e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1094 microversion: 2.1 time: 0.069490 May 24 13:03:56.000370 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 236/481] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:55 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:57.018531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7f5d9536-92c4-4b56-966b-a6d6396ad94c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:57.019176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7f5d9536-92c4-4b56-966b-a6d6396ad94c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:57.027300 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f5d9536-92c4-4b56-966b-a6d6396ad94c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:57.027744 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f5d9536-92c4-4b56-966b-a6d6396ad94c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:57.028520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f5d9536-92c4-4b56-966b-a6d6396ad94c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:57.028974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f5d9536-92c4-4b56-966b-a6d6396ad94c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:57.093980 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7f5d9536-92c4-4b56-966b-a6d6396ad94c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:57.101660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7f5d9536-92c4-4b56-966b-a6d6396ad94c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1210 microversion: 2.1 time: 0.088529 May 24 13:03:57.102355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 246/482] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:57 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:58.119214 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5a210126-4a6e-44af-9f33-bd501fc0259b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:58.119846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5a210126-4a6e-44af-9f33-bd501fc0259b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:58.130298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a210126-4a6e-44af-9f33-bd501fc0259b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:58.130758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a210126-4a6e-44af-9f33-bd501fc0259b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:58.131544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a210126-4a6e-44af-9f33-bd501fc0259b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:58.132126 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a210126-4a6e-44af-9f33-bd501fc0259b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:58.365501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5a210126-4a6e-44af-9f33-bd501fc0259b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:58.373650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5a210126-4a6e-44af-9f33-bd501fc0259b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.258428 May 24 13:03:58.374342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 237/483] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:58 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:03:58.567568 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-97a9378e-6d71-4043-9ff6-470e323d3a26 req-426a4514-3c80-4b92-84c4-f2163d8f786e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0868aa59-60f0-4ee6-8f6a-e58671fc79ad", "tag": "c6aa638f-1928-47c9-9e7a-f03f61930e51"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:03:58.593900 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-97a9378e-6d71-4043-9ff6-470e323d3a26 req-426a4514-3c80-4b92-84c4-f2163d8f786e service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:58.594728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-97a9378e-6d71-4043-9ff6-470e323d3a26 req-426a4514-3c80-4b92-84c4-f2163d8f786e service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:58.608142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-97a9378e-6d71-4043-9ff6-470e323d3a26 req-426a4514-3c80-4b92-84c4-f2163d8f786e service nova] Creating event network-changed:c6aa638f-1928-47c9-9e7a-f03f61930e51 for instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad on hv-cinder-84301 May 24 13:03:58.613499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-97a9378e-6d71-4043-9ff6-470e323d3a26 req-426a4514-3c80-4b92-84c4-f2163d8f786e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050941 May 24 13:03:58.614360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 247/484] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:03:59.391768 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-97bc2b8c-2db0-4eae-bb01-dc92c71fd79e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:03:59.392425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-97bc2b8c-2db0-4eae-bb01-dc92c71fd79e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:03:59.399534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97bc2b8c-2db0-4eae-bb01-dc92c71fd79e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:59.399981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97bc2b8c-2db0-4eae-bb01-dc92c71fd79e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:59.400751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97bc2b8c-2db0-4eae-bb01-dc92c71fd79e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:03:59.401187 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97bc2b8c-2db0-4eae-bb01-dc92c71fd79e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:03:59.532594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-97bc2b8c-2db0-4eae-bb01-dc92c71fd79e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:03:59.540698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-97bc2b8c-2db0-4eae-bb01-dc92c71fd79e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.152773 May 24 13:03:59.541449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 238/485] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:03:59 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:04:00.559025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a8ef9737-5030-4610-88e3-84c5299ba3f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:00.559656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a8ef9737-5030-4610-88e3-84c5299ba3f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:00.561610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:00.567917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8ef9737-5030-4610-88e3-84c5299ba3f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:00.568365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8ef9737-5030-4610-88e3-84c5299ba3f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:00.569128 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8ef9737-5030-4610-88e3-84c5299ba3f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:00.569566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8ef9737-5030-4610-88e3-84c5299ba3f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:00.702170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a8ef9737-5030-4610-88e3-84c5299ba3f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:00.710330 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a8ef9737-5030-4610-88e3-84c5299ba3f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.155647 May 24 13:04:00.711024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 248/486] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:00 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:01.728158 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0be870a5-0578-43c1-b2c3-851f0a587c25 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:01.728693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0be870a5-0578-43c1-b2c3-851f0a587c25 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:01.735238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0be870a5-0578-43c1-b2c3-851f0a587c25 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:01.735683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0be870a5-0578-43c1-b2c3-851f0a587c25 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:01.736436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0be870a5-0578-43c1-b2c3-851f0a587c25 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:01.736867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0be870a5-0578-43c1-b2c3-851f0a587c25 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:01.863500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0be870a5-0578-43c1-b2c3-851f0a587c25 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:01.871174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0be870a5-0578-43c1-b2c3-851f0a587c25 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.147092 May 24 13:04:01.871745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 239/487] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:01 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:02.888074 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-031ef97d-ca0a-4e93-a033-4418c59af873 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:02.888701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-031ef97d-ca0a-4e93-a033-4418c59af873 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:02.895359 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-031ef97d-ca0a-4e93-a033-4418c59af873 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:02.895814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-031ef97d-ca0a-4e93-a033-4418c59af873 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:02.896578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-031ef97d-ca0a-4e93-a033-4418c59af873 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:02.897022 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-031ef97d-ca0a-4e93-a033-4418c59af873 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:02.900910 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=77 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:03.025081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-031ef97d-ca0a-4e93-a033-4418c59af873 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:03.032982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-031ef97d-ca0a-4e93-a033-4418c59af873 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.148710 May 24 13:04:03.033569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 249/488] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:02 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:04.051178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-06d6527a-d507-434b-a675-46a5f0e1c865 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:04.051798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-06d6527a-d507-434b-a675-46a5f0e1c865 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:04.057873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06d6527a-d507-434b-a675-46a5f0e1c865 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:04.058354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06d6527a-d507-434b-a675-46a5f0e1c865 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:04.059109 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06d6527a-d507-434b-a675-46a5f0e1c865 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:04.059540 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06d6527a-d507-434b-a675-46a5f0e1c865 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:04.192872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-06d6527a-d507-434b-a675-46a5f0e1c865 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:04.200421 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-06d6527a-d507-434b-a675-46a5f0e1c865 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.153188 May 24 13:04:04.201227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 240/489] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:04 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:05.217352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f052407e-7160-474e-be5c-b6c9b31b14de tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:05.217867 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f052407e-7160-474e-be5c-b6c9b31b14de tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:05.224514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f052407e-7160-474e-be5c-b6c9b31b14de tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:05.224939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f052407e-7160-474e-be5c-b6c9b31b14de tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:05.225699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f052407e-7160-474e-be5c-b6c9b31b14de tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:05.226134 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f052407e-7160-474e-be5c-b6c9b31b14de tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:05.353562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f052407e-7160-474e-be5c-b6c9b31b14de tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:05.360994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f052407e-7160-474e-be5c-b6c9b31b14de tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.147547 May 24 13:04:05.362197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 250/490] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:05 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:06.379338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f1cae39d-6f23-42c3-981f-2c757f1b79d2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:06.380004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f1cae39d-6f23-42c3-981f-2c757f1b79d2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:06.382507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:06.388007 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1cae39d-6f23-42c3-981f-2c757f1b79d2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:06.388452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1cae39d-6f23-42c3-981f-2c757f1b79d2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:06.389217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1cae39d-6f23-42c3-981f-2c757f1b79d2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:06.389648 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1cae39d-6f23-42c3-981f-2c757f1b79d2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:06.516177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f1cae39d-6f23-42c3-981f-2c757f1b79d2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:06.523810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f1cae39d-6f23-42c3-981f-2c757f1b79d2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.148901 May 24 13:04:06.524359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 241/491] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:06 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:07.540883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b48f0ce7-0b44-42b7-967e-014cf16feff6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:07.541797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b48f0ce7-0b44-42b7-967e-014cf16feff6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:07.544038 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:07.544653 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=6 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:07.550500 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b48f0ce7-0b44-42b7-967e-014cf16feff6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:07.550957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b48f0ce7-0b44-42b7-967e-014cf16feff6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:07.551740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b48f0ce7-0b44-42b7-967e-014cf16feff6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:07.552181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b48f0ce7-0b44-42b7-967e-014cf16feff6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:07.689091 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b48f0ce7-0b44-42b7-967e-014cf16feff6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:07.698313 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b48f0ce7-0b44-42b7-967e-014cf16feff6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.161166 May 24 13:04:07.699094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 251/492] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:07 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:08.715352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60b9ea39-cc30-4074-8773-edf227ba0a18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:08.715994 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60b9ea39-cc30-4074-8773-edf227ba0a18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:08.723156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60b9ea39-cc30-4074-8773-edf227ba0a18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:08.723609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60b9ea39-cc30-4074-8773-edf227ba0a18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:08.724381 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60b9ea39-cc30-4074-8773-edf227ba0a18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:08.724837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60b9ea39-cc30-4074-8773-edf227ba0a18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:08.729726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=74 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:08.855278 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-60b9ea39-cc30-4074-8773-edf227ba0a18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:08.862783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60b9ea39-cc30-4074-8773-edf227ba0a18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.151356 May 24 13:04:08.863345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 242/493] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:08 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:09.860030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-10f9498c-0e8c-473d-b9e7-33ea18c32420 req-48df7ecd-45fc-43af-80a4-d8acd6e7ca46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0868aa59-60f0-4ee6-8f6a-e58671fc79ad", "name": "network-vif-plugged", "status": "completed", "tag": "c6aa638f-1928-47c9-9e7a-f03f61930e51"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:04:09.870085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-10f9498c-0e8c-473d-b9e7-33ea18c32420 req-48df7ecd-45fc-43af-80a4-d8acd6e7ca46 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:09.870643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-10f9498c-0e8c-473d-b9e7-33ea18c32420 req-48df7ecd-45fc-43af-80a4-d8acd6e7ca46 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:09.881778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d66d054b-b37b-4090-bf37-febb323b1c1d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:09.882591 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d66d054b-b37b-4090-bf37-febb323b1c1d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:09.884661 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-10f9498c-0e8c-473d-b9e7-33ea18c32420 req-48df7ecd-45fc-43af-80a4-d8acd6e7ca46 service nova] Creating event network-vif-plugged:c6aa638f-1928-47c9-9e7a-f03f61930e51 for instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad on hv-cinder-84301 May 24 13:04:09.889378 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d66d054b-b37b-4090-bf37-febb323b1c1d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:09.889910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d66d054b-b37b-4090-bf37-febb323b1c1d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:09.890337 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-10f9498c-0e8c-473d-b9e7-33ea18c32420 req-48df7ecd-45fc-43af-80a4-d8acd6e7ca46 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034656 May 24 13:04:09.890789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d66d054b-b37b-4090-bf37-febb323b1c1d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:09.891236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d66d054b-b37b-4090-bf37-febb323b1c1d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:09.891406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 252/494] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:04:10.030079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d66d054b-b37b-4090-bf37-febb323b1c1d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:10.039416 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d66d054b-b37b-4090-bf37-febb323b1c1d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.162337 May 24 13:04:10.039977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 243/495] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:09 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:11.056768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2f1e89b5-b234-4b54-a993-c33c07102e18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:11.057466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2f1e89b5-b234-4b54-a993-c33c07102e18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:11.063811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f1e89b5-b234-4b54-a993-c33c07102e18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:11.065100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f1e89b5-b234-4b54-a993-c33c07102e18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:11.065869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f1e89b5-b234-4b54-a993-c33c07102e18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:11.066307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f1e89b5-b234-4b54-a993-c33c07102e18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:11.201483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2f1e89b5-b234-4b54-a993-c33c07102e18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:11.209261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2f1e89b5-b234-4b54-a993-c33c07102e18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1266 microversion: 2.1 time: 0.156601 May 24 13:04:11.209868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 253/496] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:11 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:12.228873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ff65a71f-080d-4332-8349-539b59afd1f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:12.229792 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ff65a71f-080d-4332-8349-539b59afd1f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:12.238937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff65a71f-080d-4332-8349-539b59afd1f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:12.239477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff65a71f-080d-4332-8349-539b59afd1f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:12.240573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff65a71f-080d-4332-8349-539b59afd1f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:12.241171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff65a71f-080d-4332-8349-539b59afd1f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:12.392317 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff65a71f-080d-4332-8349-539b59afd1f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:12.399826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ff65a71f-080d-4332-8349-539b59afd1f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1453 microversion: 2.1 time: 0.177104 May 24 13:04:12.400390 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 244/497] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:12 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:12.416721 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-858cff62-1ac0-41f4-a4de-0ba8193d6336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:12.417438 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-858cff62-1ac0-41f4-a4de-0ba8193d6336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:12.423957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-858cff62-1ac0-41f4-a4de-0ba8193d6336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:12.424438 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-858cff62-1ac0-41f4-a4de-0ba8193d6336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:12.425200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-858cff62-1ac0-41f4-a4de-0ba8193d6336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:12.425671 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-858cff62-1ac0-41f4-a4de-0ba8193d6336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:12.559987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-858cff62-1ac0-41f4-a4de-0ba8193d6336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:12.568079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-858cff62-1ac0-41f4-a4de-0ba8193d6336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1453 microversion: 2.1 time: 0.155156 May 24 13:04:12.568640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 254/498] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:12 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:14.559542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-6e5122e5-1662-4c31-baef-994eb1022d2f req-663866a9-ef77-4b93-a337-00c731945f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0868aa59-60f0-4ee6-8f6a-e58671fc79ad", "tag": "c6aa638f-1928-47c9-9e7a-f03f61930e51"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:04:14.568129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6e5122e5-1662-4c31-baef-994eb1022d2f req-663866a9-ef77-4b93-a337-00c731945f39 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:14.568587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6e5122e5-1662-4c31-baef-994eb1022d2f req-663866a9-ef77-4b93-a337-00c731945f39 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:14.580196 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-6e5122e5-1662-4c31-baef-994eb1022d2f req-663866a9-ef77-4b93-a337-00c731945f39 service nova] Creating event network-changed:c6aa638f-1928-47c9-9e7a-f03f61930e51 for instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad on hv-cinder-84301 May 24 13:04:14.585457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-6e5122e5-1662-4c31-baef-994eb1022d2f req-663866a9-ef77-4b93-a337-00c731945f39 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029949 May 24 13:04:14.586420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 245/499] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:04:21.784442 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6691768a-2a41-46c5-b056-2052ae9237e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:21.784941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6691768a-2a41-46c5-b056-2052ae9237e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:21.792624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6691768a-2a41-46c5-b056-2052ae9237e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:21.793337 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6691768a-2a41-46c5-b056-2052ae9237e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:21.793937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6691768a-2a41-46c5-b056-2052ae9237e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:21.794453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6691768a-2a41-46c5-b056-2052ae9237e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:21.819655 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6691768a-2a41-46c5-b056-2052ae9237e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/ips" status: 200 len: 145 microversion: 2.1 time: 0.039506 May 24 13:04:21.820272 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 255/500] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 13:04:21 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:04:23.877856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ce9f3da3-bcce-4702-add0-51a48f0c86e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d99c90be-8355-4062-989d-01dfd027293c"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:04:23.879167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ce9f3da3-bcce-4702-add0-51a48f0c86e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:23.881792 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:23.887347 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce9f3da3-bcce-4702-add0-51a48f0c86e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:23.887802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce9f3da3-bcce-4702-add0-51a48f0c86e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:23.888567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce9f3da3-bcce-4702-add0-51a48f0c86e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:23.889008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce9f3da3-bcce-4702-add0-51a48f0c86e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:24.129543 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ce9f3da3-bcce-4702-add0-51a48f0c86e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256241 May 24 13:04:24.130260 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 246/501] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 13:04:23 2022] POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:04:27.788369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c0fb2632-e229-4b39-b18d-25e6ccde31fd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:27.788906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c0fb2632-e229-4b39-b18d-25e6ccde31fd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:27.794877 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0fb2632-e229-4b39-b18d-25e6ccde31fd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:27.795319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0fb2632-e229-4b39-b18d-25e6ccde31fd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:27.796062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0fb2632-e229-4b39-b18d-25e6ccde31fd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:27.796491 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0fb2632-e229-4b39-b18d-25e6ccde31fd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:27.818737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c0fb2632-e229-4b39-b18d-25e6ccde31fd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/ips" status: 200 len: 152 microversion: 2.20 time: 0.034306 May 24 13:04:27.819453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 256/502] 10.222.0.45 () {60 vars in 1288 bytes} [Tue May 24 13:04:27 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:04:30.738071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f0d57cf0-d954-4a0d-bd5c-272e402682b9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:04:30.738674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f0d57cf0-d954-4a0d-bd5c-272e402682b9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:30.745117 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0d57cf0-d954-4a0d-bd5c-272e402682b9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:30.745563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0d57cf0-d954-4a0d-bd5c-272e402682b9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:30.746348 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0d57cf0-d954-4a0d-bd5c-272e402682b9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:30.746784 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0d57cf0-d954-4a0d-bd5c-272e402682b9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:30.774678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-f0d57cf0-d954-4a0d-bd5c-272e402682b9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lazy-loading 'flavor' on Instance uuid 8dbd25ed-5661-4c08-949c-27204c6c1172 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:04:31.065250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f0d57cf0-d954-4a0d-bd5c-272e402682b9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/action" status: 202 len: 0 microversion: 2.20 time: 0.331565 May 24 13:04:31.066019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 247/503] 10.222.0.45 () {62 vars in 1318 bytes} [Tue May 24 13:04:30 2022] POST /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 13:04:31.074045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:31.075404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:31.077298 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=18 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:31.083250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:31.083712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:31.084494 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:31.084936 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:31.225475 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:31.233486 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:31.235037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:31.236741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d5bf0b56-b4d8-405f-99fa-bfba446cf2f5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.166766 May 24 13:04:31.237293 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 257/504] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:31 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:31.617801 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3ef57254-0666-410c-a360-c83977f856e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:04:31.624120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ef57254-0666-410c-a360-c83977f856e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:31.624569 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ef57254-0666-410c-a360-c83977f856e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:31.684972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3ef57254-0666-410c-a360-c83977f856e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Going to try to stop instance {{(pid=117642) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 13:04:31.726168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3ef57254-0666-410c-a360-c83977f856e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/action" status: 202 len: 0 microversion: 2.1 time: 0.113139 May 24 13:04:31.726790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 248/505] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:04:31 2022] POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:04:31.735899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-71ebe9f8-1e63-4ef3-adda-225908690c49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:31.736512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-71ebe9f8-1e63-4ef3-adda-225908690c49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:31.742821 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71ebe9f8-1e63-4ef3-adda-225908690c49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:31.743452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71ebe9f8-1e63-4ef3-adda-225908690c49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:31.744456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71ebe9f8-1e63-4ef3-adda-225908690c49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:31.745041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71ebe9f8-1e63-4ef3-adda-225908690c49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:31.872969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-71ebe9f8-1e63-4ef3-adda-225908690c49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:31.880905 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-71ebe9f8-1e63-4ef3-adda-225908690c49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.149925 May 24 13:04:31.881474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 258/506] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:31 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:04:32.257082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:32.257785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:32.263981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:32.264431 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:32.265199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:32.265636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:32.402392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:32.411793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:32.413563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:32.415044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4da2b2de-e9a5-4984-98fd-0d3d5430c544 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.162645 May 24 13:04:32.415774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 249/507] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:32 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:32.898772 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-56f3a150-0ec6-4536-a05e-574788180a0f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:32.899381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-56f3a150-0ec6-4536-a05e-574788180a0f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:32.905671 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56f3a150-0ec6-4536-a05e-574788180a0f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:32.906112 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56f3a150-0ec6-4536-a05e-574788180a0f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:32.906920 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56f3a150-0ec6-4536-a05e-574788180a0f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:32.912865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56f3a150-0ec6-4536-a05e-574788180a0f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:32.923012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=54 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:33.050753 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-56f3a150-0ec6-4536-a05e-574788180a0f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:33.059211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-56f3a150-0ec6-4536-a05e-574788180a0f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.164093 May 24 13:04:33.059805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 259/508] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:32 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:33.434437 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:33.435056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:33.441583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:33.442038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:33.442838 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:33.443280 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:33.572685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:33.581171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:33.582716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:33.583857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-449d8ca1-90f1-45c5-aa90-37ba00a7953a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.153420 May 24 13:04:33.584418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 250/509] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:33 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:34.076770 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-261bfdbc-0b50-4ec5-96a9-f9a95b9e57d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:34.077390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-261bfdbc-0b50-4ec5-96a9-f9a95b9e57d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:34.083631 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-261bfdbc-0b50-4ec5-96a9-f9a95b9e57d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:34.084120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-261bfdbc-0b50-4ec5-96a9-f9a95b9e57d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:34.084888 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-261bfdbc-0b50-4ec5-96a9-f9a95b9e57d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:34.085329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-261bfdbc-0b50-4ec5-96a9-f9a95b9e57d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:34.208540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-261bfdbc-0b50-4ec5-96a9-f9a95b9e57d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:34.216585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-261bfdbc-0b50-4ec5-96a9-f9a95b9e57d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.143672 May 24 13:04:34.217154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 260/510] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:34 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:34.601780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:34.602415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:34.608993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:34.609441 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:34.610852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:34.611309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:34.736688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:34.744780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:34.746273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:34.747447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f1215b7d-6d0f-4efc-a837-62d2046ac2c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.149588 May 24 13:04:34.748001 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 251/511] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:34 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:35.232858 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-84114723-1bfe-47cf-b7fc-c3e5a92b916b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:35.233471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-84114723-1bfe-47cf-b7fc-c3e5a92b916b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:35.239499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-84114723-1bfe-47cf-b7fc-c3e5a92b916b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:35.239950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-84114723-1bfe-47cf-b7fc-c3e5a92b916b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:35.240701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-84114723-1bfe-47cf-b7fc-c3e5a92b916b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:35.241138 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-84114723-1bfe-47cf-b7fc-c3e5a92b916b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:35.368358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-84114723-1bfe-47cf-b7fc-c3e5a92b916b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:35.377120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-84114723-1bfe-47cf-b7fc-c3e5a92b916b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.148094 May 24 13:04:35.377769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 261/512] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:35 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:35.765285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:35.765899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:35.772418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:35.772864 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:35.773627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:35.774064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:35.899574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:35.908124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:35.909641 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:35.910825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-252df69d-e54a-47e3-a8f4-56dd49f83c76 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.149444 May 24 13:04:35.911382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 252/513] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:35 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:36.395924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-86ad356c-5f45-43af-85e4-3899331e8a6a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:36.395924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-86ad356c-5f45-43af-85e4-3899331e8a6a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:36.405247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86ad356c-5f45-43af-85e4-3899331e8a6a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:36.405247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86ad356c-5f45-43af-85e4-3899331e8a6a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:36.405832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86ad356c-5f45-43af-85e4-3899331e8a6a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:36.406268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86ad356c-5f45-43af-85e4-3899331e8a6a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:36.532954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-86ad356c-5f45-43af-85e4-3899331e8a6a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:36.540834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-86ad356c-5f45-43af-85e4-3899331e8a6a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.150429 May 24 13:04:36.541396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 262/514] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:36 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:36.929403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:36.930003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:36.936479 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:36.936919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:36.937668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:36.938117 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:37.077002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:37.085448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:37.086988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:37.088135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e304a2ed-e302-4ad5-bc50-c9d4679a1864 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.162579 May 24 13:04:37.088677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 253/515] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:36 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:37.558584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d87a0dea-2150-4c53-82fb-69e4f045ade8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:37.559195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d87a0dea-2150-4c53-82fb-69e4f045ade8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:37.565614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d87a0dea-2150-4c53-82fb-69e4f045ade8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:37.566057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d87a0dea-2150-4c53-82fb-69e4f045ade8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:37.566835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d87a0dea-2150-4c53-82fb-69e4f045ade8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:37.567269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d87a0dea-2150-4c53-82fb-69e4f045ade8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:37.694940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d87a0dea-2150-4c53-82fb-69e4f045ade8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:37.702697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d87a0dea-2150-4c53-82fb-69e4f045ade8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.147883 May 24 13:04:37.703256 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 263/516] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:37 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:38.107764 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:38.108377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:38.115474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:38.115919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:38.116674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:38.117365 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:38.246324 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:38.254261 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:38.255771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:38.256904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-daf154e7-f255-4842-8560-dcf09c5314db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.152987 May 24 13:04:38.257444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 254/517] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:38 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:38.720081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7d560109-c4a5-4314-ae0d-00e05e68b48b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:38.720658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7d560109-c4a5-4314-ae0d-00e05e68b48b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:38.726541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7d560109-c4a5-4314-ae0d-00e05e68b48b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:38.726983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7d560109-c4a5-4314-ae0d-00e05e68b48b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:38.727729 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7d560109-c4a5-4314-ae0d-00e05e68b48b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:38.728162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7d560109-c4a5-4314-ae0d-00e05e68b48b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:38.853762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7d560109-c4a5-4314-ae0d-00e05e68b48b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:38.861715 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7d560109-c4a5-4314-ae0d-00e05e68b48b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.146236 May 24 13:04:38.862298 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 264/518] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:38 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:39.274786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:39.275428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:39.283104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:39.283546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:39.284301 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:39.284726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:39.287360 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:39.411745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:39.426063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:39.427849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:39.428995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-502d402b-c15e-4a16-af53-1d95acb21e6c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.158315 May 24 13:04:39.429745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 255/519] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:39 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:39.879164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e511e316-dd4f-4778-ac1b-65c1a35caf8d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:39.879694 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e511e316-dd4f-4778-ac1b-65c1a35caf8d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:39.885643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e511e316-dd4f-4778-ac1b-65c1a35caf8d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:39.886089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e511e316-dd4f-4778-ac1b-65c1a35caf8d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:39.886953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e511e316-dd4f-4778-ac1b-65c1a35caf8d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:39.887389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e511e316-dd4f-4778-ac1b-65c1a35caf8d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:40.010471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e511e316-dd4f-4778-ac1b-65c1a35caf8d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:40.018901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e511e316-dd4f-4778-ac1b-65c1a35caf8d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.143689 May 24 13:04:40.019488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 265/520] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:39 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:40.448252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:40.448857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:40.456991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:40.457902 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:40.458662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:40.459232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:40.585132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:40.592942 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:40.594467 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:40.595603 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-40214bb6-cfba-4504-bac6-89ada694f8b8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.151290 May 24 13:04:40.596154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 256/521] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:40 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:41.036526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4be39d01-5508-4c6a-905f-18d9be5c3c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:41.037147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4be39d01-5508-4c6a-905f-18d9be5c3c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:41.043267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4be39d01-5508-4c6a-905f-18d9be5c3c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:41.043756 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4be39d01-5508-4c6a-905f-18d9be5c3c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:41.044519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4be39d01-5508-4c6a-905f-18d9be5c3c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:41.044966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4be39d01-5508-4c6a-905f-18d9be5c3c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:41.175142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-4be39d01-5508-4c6a-905f-18d9be5c3c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:41.183033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4be39d01-5508-4c6a-905f-18d9be5c3c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.150860 May 24 13:04:41.183788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 266/522] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:41 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:41.613699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:41.614319 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:41.621059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:41.621501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:41.622249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:41.622704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:41.751015 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:41.759422 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:41.760930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:41.762079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2eec631f-d727-4f57-9091-726677b722be tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.152192 May 24 13:04:41.762656 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 257/523] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:41 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:42.200084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-de03d7a4-8130-4ded-88ad-1cd577e1e898 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:42.200703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-de03d7a4-8130-4ded-88ad-1cd577e1e898 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:42.207357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de03d7a4-8130-4ded-88ad-1cd577e1e898 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:42.207806 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de03d7a4-8130-4ded-88ad-1cd577e1e898 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:42.208562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de03d7a4-8130-4ded-88ad-1cd577e1e898 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:42.208997 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de03d7a4-8130-4ded-88ad-1cd577e1e898 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:42.334863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-de03d7a4-8130-4ded-88ad-1cd577e1e898 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:42.342742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-de03d7a4-8130-4ded-88ad-1cd577e1e898 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.146519 May 24 13:04:42.343303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 267/524] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:42 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:42.780084 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:42.780736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:42.787278 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:42.787730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:42.788555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:42.788933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:42.914392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:42.922151 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:42.923671 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:42.925313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b8b80fe0-5964-4f1a-bf6d-b01fd4304441 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.149170 May 24 13:04:42.925854 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 258/525] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:42 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:43.360457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-163fdd40-1fd7-4aec-8768-100336fd370f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:43.361063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-163fdd40-1fd7-4aec-8768-100336fd370f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:43.367907 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-163fdd40-1fd7-4aec-8768-100336fd370f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:43.368348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-163fdd40-1fd7-4aec-8768-100336fd370f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:43.369092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-163fdd40-1fd7-4aec-8768-100336fd370f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:43.369544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-163fdd40-1fd7-4aec-8768-100336fd370f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:43.519190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-163fdd40-1fd7-4aec-8768-100336fd370f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:43.527019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-163fdd40-1fd7-4aec-8768-100336fd370f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.170409 May 24 13:04:43.527576 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 268/526] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:43 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:43.943359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:43.943887 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:43.950619 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:43.951066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:43.951823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:43.952251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:44.083357 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:44.091317 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:44.092825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:44.094004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6b088585-ea7c-4a97-90b3-d988c1cf27b7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1744 microversion: 2.20 time: 0.154568 May 24 13:04:44.094594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 259/527] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:43 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:44.544521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8b19dedf-aacb-4cf6-a3b7-466f3118abbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:44.545131 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8b19dedf-aacb-4cf6-a3b7-466f3118abbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:44.551592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b19dedf-aacb-4cf6-a3b7-466f3118abbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:44.552032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b19dedf-aacb-4cf6-a3b7-466f3118abbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:44.552779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b19dedf-aacb-4cf6-a3b7-466f3118abbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:44.553211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b19dedf-aacb-4cf6-a3b7-466f3118abbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:44.676025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8b19dedf-aacb-4cf6-a3b7-466f3118abbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:44.683848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8b19dedf-aacb-4cf6-a3b7-466f3118abbb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.143143 May 24 13:04:44.684399 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 269/528] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:44 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:45.113262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:45.113870 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:45.120729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:45.121174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:45.121931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:45.122423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:45.248787 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:45.257481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:45.259037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:45.260195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0adb8771-1ea8-4225-9258-a05e90ab22df tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1744 microversion: 2.20 time: 0.151392 May 24 13:04:45.260730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 260/529] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:45 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:45.701272 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f09ee0cb-0f2e-447a-972b-e23eb6765c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:45.701825 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f09ee0cb-0f2e-447a-972b-e23eb6765c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:45.708482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f09ee0cb-0f2e-447a-972b-e23eb6765c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:45.708927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f09ee0cb-0f2e-447a-972b-e23eb6765c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:45.709685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f09ee0cb-0f2e-447a-972b-e23eb6765c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:45.710123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f09ee0cb-0f2e-447a-972b-e23eb6765c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:45.833355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f09ee0cb-0f2e-447a-972b-e23eb6765c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:45.841371 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f09ee0cb-0f2e-447a-972b-e23eb6765c9a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.144004 May 24 13:04:45.841929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 270/530] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:45 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:46.038789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-16877fe0-53a1-4eea-b5a0-b0b2327cf2a4 req-579cc381-bac8-4d7a-9527-7a8d6b68c545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dbd25ed-5661-4c08-949c-27204c6c1172", "name": "network-vif-plugged", "status": "completed", "tag": "d4232814-2adb-4fc6-bd44-4cb7c7da4de1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:04:46.047288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-16877fe0-53a1-4eea-b5a0-b0b2327cf2a4 req-579cc381-bac8-4d7a-9527-7a8d6b68c545 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:46.047730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-16877fe0-53a1-4eea-b5a0-b0b2327cf2a4 req-579cc381-bac8-4d7a-9527-7a8d6b68c545 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:46.059175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-16877fe0-53a1-4eea-b5a0-b0b2327cf2a4 req-579cc381-bac8-4d7a-9527-7a8d6b68c545 service nova] Creating event network-vif-plugged:d4232814-2adb-4fc6-bd44-4cb7c7da4de1 for instance 8dbd25ed-5661-4c08-949c-27204c6c1172 on hv-cinder-84301 May 24 13:04:46.064049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-16877fe0-53a1-4eea-b5a0-b0b2327cf2a4 req-579cc381-bac8-4d7a-9527-7a8d6b68c545 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028859 May 24 13:04:46.064630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 261/531] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:04:46.279042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:46.279613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:46.286193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:46.286674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:46.287444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:46.287881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:46.416820 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:46.425320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:46.426863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:46.428054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-63ae5333-4ab5-47fd-bf32-1bf132c96153 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1744 microversion: 2.20 time: 0.153875 May 24 13:04:46.428622 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 271/532] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:46 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:46.861699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7633e6db-88e4-457b-8a17-e96af0eddcd3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:46.862438 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7633e6db-88e4-457b-8a17-e96af0eddcd3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:46.868933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7633e6db-88e4-457b-8a17-e96af0eddcd3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:46.869380 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7633e6db-88e4-457b-8a17-e96af0eddcd3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:46.870145 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7633e6db-88e4-457b-8a17-e96af0eddcd3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:46.870609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7633e6db-88e4-457b-8a17-e96af0eddcd3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:46.995340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7633e6db-88e4-457b-8a17-e96af0eddcd3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:47.003732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7633e6db-88e4-457b-8a17-e96af0eddcd3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1724 microversion: 2.1 time: 0.146673 May 24 13:04:47.004290 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 262/533] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:46 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:47.452008 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:47.452777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:47.459097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:47.459540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:47.460301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:47.460733 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:47.585803 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:47.593730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:47.595256 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:47.596393 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6d94ff96-31f9-478c-bd7f-f0822a533098 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1744 microversion: 2.20 time: 0.148297 May 24 13:04:47.596941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 272/534] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:47 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:04:48.020695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2e1bfa03-1d31-4c07-be08-14b15078088a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:48.021310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2e1bfa03-1d31-4c07-be08-14b15078088a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:48.027858 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e1bfa03-1d31-4c07-be08-14b15078088a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:48.028313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e1bfa03-1d31-4c07-be08-14b15078088a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:48.029075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e1bfa03-1d31-4c07-be08-14b15078088a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:48.029512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e1bfa03-1d31-4c07-be08-14b15078088a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:48.158865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2e1bfa03-1d31-4c07-be08-14b15078088a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:48.167402 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2e1bfa03-1d31-4c07-be08-14b15078088a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1701 microversion: 2.1 time: 0.150632 May 24 13:04:48.167975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 263/535] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:48 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1701 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:48.183551 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a2ef8440-595c-4f07-8fcf-acacec2c50dd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:04:48.189529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2ef8440-595c-4f07-8fcf-acacec2c50dd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:48.189974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2ef8440-595c-4f07-8fcf-acacec2c50dd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:48.248027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a2ef8440-595c-4f07-8fcf-acacec2c50dd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Going to try to start instance {{(pid=117643) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 13:04:48.288456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a2ef8440-595c-4f07-8fcf-acacec2c50dd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/action" status: 202 len: 0 microversion: 2.1 time: 0.108563 May 24 13:04:48.288966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 273/536] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:04:48 2022] POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:04:48.297163 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-93407f8a-a4f7-4505-8e98-cc0df8480a31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:48.297863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-93407f8a-a4f7-4505-8e98-cc0df8480a31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:48.304035 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93407f8a-a4f7-4505-8e98-cc0df8480a31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:48.304427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93407f8a-a4f7-4505-8e98-cc0df8480a31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:48.305301 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93407f8a-a4f7-4505-8e98-cc0df8480a31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:48.305739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93407f8a-a4f7-4505-8e98-cc0df8480a31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:48.476230 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-93407f8a-a4f7-4505-8e98-cc0df8480a31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:48.484223 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-93407f8a-a4f7-4505-8e98-cc0df8480a31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1710 microversion: 2.1 time: 0.190974 May 24 13:04:48.484790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 264/537] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:48 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1710 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:48.614685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:48.615374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:48.621671 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:48.622118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:48.622899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:48.623330 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:48.754426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:48.762403 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:48.763916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:48.765069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-24b0b2bc-985b-4e55-9e38-5adc4d94a08b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1744 microversion: 2.20 time: 0.154739 May 24 13:04:48.765632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 274/538] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:48 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:49.504499 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7df9fdf7-ed0e-440b-a03f-832a43dce597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:49.505113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7df9fdf7-ed0e-440b-a03f-832a43dce597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:49.511660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7df9fdf7-ed0e-440b-a03f-832a43dce597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:49.512140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7df9fdf7-ed0e-440b-a03f-832a43dce597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:49.512906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7df9fdf7-ed0e-440b-a03f-832a43dce597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:49.513342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7df9fdf7-ed0e-440b-a03f-832a43dce597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:49.640473 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7df9fdf7-ed0e-440b-a03f-832a43dce597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:49.648761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7df9fdf7-ed0e-440b-a03f-832a43dce597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1710 microversion: 2.1 time: 0.148116 May 24 13:04:49.649315 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 265/539] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:49 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1710 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:49.783050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:49.784174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:49.790115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:49.790585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:49.791334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:49.791763 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:49.794362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:49.920340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:49.928171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:49.929675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:49.930850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c8f172d2-4773-44ba-88c3-2576dc0727c8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1744 microversion: 2.20 time: 0.151840 May 24 13:04:49.931391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 275/540] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:49 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:50.664808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef850ed3-1daf-4972-b8f4-bafcbd993ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:50.665431 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ef850ed3-1daf-4972-b8f4-bafcbd993ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:50.672347 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef850ed3-1daf-4972-b8f4-bafcbd993ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:50.672799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef850ed3-1daf-4972-b8f4-bafcbd993ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:50.673564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef850ed3-1daf-4972-b8f4-bafcbd993ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:50.674671 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef850ed3-1daf-4972-b8f4-bafcbd993ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:50.808039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ef850ed3-1daf-4972-b8f4-bafcbd993ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:50.817279 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ef850ed3-1daf-4972-b8f4-bafcbd993ff9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1714 microversion: 2.1 time: 0.156216 May 24 13:04:50.817862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 266/541] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:04:50 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:04:50.948844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:50.949472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:50.956041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:50.956496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:50.957266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:50.957704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:51.131831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:51.140938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:51.142619 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:51.144679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dc7d6b76-836c-4b10-bb58-c79de4795aea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1739 microversion: 2.20 time: 0.199623 May 24 13:04:51.145800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 276/542] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:50 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:52.164154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:52.164763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:52.171742 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:52.172274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:52.173205 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:52.173890 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:52.328756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:52.338045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:52.339713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:52.341548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cc597fe7-5752-4e36-a0da-6946e8693422 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1739 microversion: 2.20 time: 0.181061 May 24 13:04:52.342494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 267/543] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:52 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:04:53.361118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:53.363207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:53.370845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:53.371307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:53.372092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:53.372528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:53.531772 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:53.541160 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:53.542817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:53.544050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-100bf234-251a-4d85-9936-3c0ba65d33f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1739 microversion: 2.20 time: 0.187677 May 24 13:04:53.544687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 277/544] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:53 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:54.562468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:54.563067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:54.565527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=44 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:54.570649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:54.571106 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:54.571878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:54.572312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:54.935912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:54.947916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:54.951266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:54.953234 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-583e2903-e594-456d-a553-1c18fb4d2ca1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1739 microversion: 2.20 time: 0.394634 May 24 13:04:54.954462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 268/545] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:54 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:55.973775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:55.974432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:55.980637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:55.981119 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:55.981919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:55.982378 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:56.121149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:56.130012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:56.131873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:56.133285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8a3be260-9b21-4bf3-9b24-9a089c76854e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1739 microversion: 2.20 time: 0.164091 May 24 13:04:56.133865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 278/546] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:55 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:57.151514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:57.152142 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:57.159939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:57.160393 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:57.161170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:57.161668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:57.298561 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:57.306810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:57.308327 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:57.309507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-affedf73-8435-4f70-a07b-6d8049b3ec0b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1739 microversion: 2.20 time: 0.161916 May 24 13:04:57.320208 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 269/547] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:57 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:04:58.328030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:58.328661 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:58.335325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:58.335866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:58.336822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:58.337394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:58.677102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:58.684944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:58.686465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:58.687647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-850e86a1-65ce-49aa-a6ab-dbf81f8b02d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1739 microversion: 2.20 time: 0.363634 May 24 13:04:58.688540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 279/548] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:58 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:04:59.706777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:04:59.708035 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:04:59.715266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:59.715722 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:59.716499 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:04:59.716954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:04:59.917849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:59.926612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:59.928252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:04:59.929618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-369b3584-bb97-4914-bd9f-61885e051049 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1739 microversion: 2.20 time: 0.227354 May 24 13:04:59.932103 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 270/549] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:04:59 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:00.953370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:00.953976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:00.959942 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:00.960411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:00.961164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:00.961592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:01.087355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:01.095646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:01.097136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:01.098271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-334e7ece-a7cd-4459-8efd-a58c1818dd93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1739 microversion: 2.20 time: 0.148850 May 24 13:05:01.098882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 280/550] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:00 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:02.116539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:02.117141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:02.123675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:02.124122 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:02.124876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:02.125308 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:02.255179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:02.263164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:02.264670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:02.265818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a452328f-c292-4bcb-8463-9b84bf42d52d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1721 microversion: 2.20 time: 0.153428 May 24 13:05:02.266403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 271/551] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:02 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:03.285556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:03.286165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:03.288142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=48 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:03.293704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:03.294149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:03.294937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:03.295370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:03.423523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:03.431454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:03.432969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:03.434122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-eb32cd66-8e09-4b17-b522-00d40b2080a2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1721 microversion: 2.20 time: 0.153170 May 24 13:05:03.434712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 281/552] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:03 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:04.084947 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-a03c7f85-8191-4f04-b543-4082fe354b8d req-5a8229c8-1a42-448a-b54f-d85508a34cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dbd25ed-5661-4c08-949c-27204c6c1172", "name": "network-vif-unplugged", "status": "completed", "tag": "d4232814-2adb-4fc6-bd44-4cb7c7da4de1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:05:04.095418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a03c7f85-8191-4f04-b543-4082fe354b8d req-5a8229c8-1a42-448a-b54f-d85508a34cdb service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:04.095868 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a03c7f85-8191-4f04-b543-4082fe354b8d req-5a8229c8-1a42-448a-b54f-d85508a34cdb service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:04.106699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.compute.server_external_events [req-a03c7f85-8191-4f04-b543-4082fe354b8d req-5a8229c8-1a42-448a-b54f-d85508a34cdb service nova] Unable to find a host for instance 8dbd25ed-5661-4c08-949c-27204c6c1172. Dropping event network-vif-unplugged {{(pid=117642) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 24 13:05:04.107559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-a03c7f85-8191-4f04-b543-4082fe354b8d req-5a8229c8-1a42-448a-b54f-d85508a34cdb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026734 May 24 13:05:04.108288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 272/553] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 24 13:05:04.452176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:04.452793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:04.458833 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:04.459286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:04.460050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:04.460494 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:04.588453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:04.597031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:04.598582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:04.599742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-820a0ab6-083b-458d-8384-d0db22501a9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1664 microversion: 2.20 time: 0.151466 May 24 13:05:04.600306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 282/554] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:04 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:04.618679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-132c9d1f-aeb6-4b71-8dcd-57a20cf8b1f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b256f919-cbcf-4d7b-9653-d576f9716e09"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:05:04.618905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-132c9d1f-aeb6-4b71-8dcd-57a20cf8b1f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:04.625050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-132c9d1f-aeb6-4b71-8dcd-57a20cf8b1f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:04.625501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-132c9d1f-aeb6-4b71-8dcd-57a20cf8b1f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:04.626267 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-132c9d1f-aeb6-4b71-8dcd-57a20cf8b1f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:04.626721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-132c9d1f-aeb6-4b71-8dcd-57a20cf8b1f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:04.630269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:04.906095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-132c9d1f-aeb6-4b71-8dcd-57a20cf8b1f0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292540 May 24 13:05:04.906702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 273/555] 10.222.0.45 () {62 vars in 1363 bytes} [Tue May 24 13:05:04 2022] POST /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:05:05.022241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dd0f941d-0cc5-4946-ac8d-48e8f10f3c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:05:05.022839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dd0f941d-0cc5-4946-ac8d-48e8f10f3c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:05.028939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd0f941d-0cc5-4946-ac8d-48e8f10f3c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:05.029391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd0f941d-0cc5-4946-ac8d-48e8f10f3c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:05.030148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd0f941d-0cc5-4946-ac8d-48e8f10f3c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:05.030631 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd0f941d-0cc5-4946-ac8d-48e8f10f3c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:05.121079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dd0f941d-0cc5-4946-ac8d-48e8f10f3c9c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/action" status: 202 len: 0 microversion: 2.20 time: 0.103207 May 24 13:05:05.121600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 283/556] 10.222.0.45 () {62 vars in 1318 bytes} [Tue May 24 13:05:05 2022] POST /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 13:05:05.130626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:05.131318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:05.138571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:05.139090 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:05.139915 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:05.140417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:05.272687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:05.281704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:05.283262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:05.284493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-04a814cd-13bc-435b-bd4e-e053475d6b98 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1750 microversion: 2.20 time: 0.158635 May 24 13:05:05.285052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 274/557] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:05 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:06.303145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:06.303779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:06.309771 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:06.310357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:06.311165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:06.311648 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:06.443280 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:06.451635 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:06.453069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:06.454210 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b5edcd69-843c-4809-b011-9fb58dc61c21 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1752 microversion: 2.20 time: 0.154977 May 24 13:05:06.454787 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 284/558] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:06 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:07.472968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:07.473573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:07.480583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:07.481027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:07.481794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:07.482226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:07.695368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:07.703752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:07.705233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:07.706408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e1149e33-038e-4c64-83a7-6d7df64f19c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.237454 May 24 13:05:07.706967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 275/559] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:07 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:08.724580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:08.725120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:08.731776 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:08.732472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:08.733389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:08.733825 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:08.869500 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:08.878731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:08.880258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:08.881432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7f7c6c43-98e7-4b4f-9f95-2d08a264861f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.160891 May 24 13:05:08.882000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 285/560] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:08 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:10.025803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:10.026447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:10.032406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:10.032855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:10.034519 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:10.035094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:10.174111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:10.183154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:10.184647 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:10.185788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-62075eb8-54c6-43c4-a442-8f5e4e50a39a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.289876 May 24 13:05:10.186355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 276/561] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:09 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:11.204495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:11.205205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:11.211713 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:11.212173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:11.212959 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:11.213401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:11.353667 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:11.363026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:11.364540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:11.365740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c98d74e0-9623-4c57-aa4f-e56194dded80 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.165306 May 24 13:05:11.366594 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 286/562] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:11 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:12.385010 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:12.385646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:12.392272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:12.392970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:12.393935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:12.394569 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:12.532368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:12.546874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:12.548397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:12.550229 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5464b0ed-4782-4f7a-a366-688d9885155b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.169385 May 24 13:05:12.550836 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 277/563] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:12 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:13.568658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:13.569267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:13.575642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:13.576099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:13.576863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:13.577303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:13.708529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:13.716716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:13.718253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:13.719421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-57406f6b-93c5-47fa-ad68-127af15bd6fa tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.155261 May 24 13:05:13.719982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 287/564] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:13 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:14.737660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:14.738427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:14.745693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:14.746226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:14.747084 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:14.747594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:14.886262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:14.894900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:14.896397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:14.897544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-804e3c09-6672-4177-bc46-a8174aa778b4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.164484 May 24 13:05:14.898100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 278/565] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:14 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:15.916762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:15.917474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:15.923828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:15.924277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:15.925040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:15.925480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:16.056458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:16.065186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:16.066748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:16.067947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-225bf4d9-9d49-480d-8bf5-0f9191f50b93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.155309 May 24 13:05:16.068503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 288/566] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:15 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:17.086992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:17.087599 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:17.094753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:17.095340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:17.096216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:17.096723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:17.226625 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:17.235334 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:17.237155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:17.238651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bea24b45-6ff4-40be-871d-bc231f492712 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.155509 May 24 13:05:17.239288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 279/567] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:17 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:18.257015 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:18.257672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:18.263880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:18.264327 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:18.265095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:18.265532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:18.420450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:18.429292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:18.438695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:18.439964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6e1f0a30-46da-4b5a-ab2a-3c210f7bef01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.186935 May 24 13:05:18.440557 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 289/568] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:18 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:19.458891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:19.459506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:19.466135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:19.466618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:19.467388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:19.467823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:19.593428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:19.602045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:19.603577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:19.604729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5286abbd-5bef-4b95-95b8-7a37c136f52e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.150352 May 24 13:05:19.605288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 280/569] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:19 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:20.623161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:20.623772 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:20.629855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:20.630325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:20.631086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:20.631519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:20.635357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:20.758211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:20.766592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:20.768710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:20.769935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a0bb873c-ef5a-4369-a88c-1a0cdeb4fa4f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.150671 May 24 13:05:20.770535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 290/570] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:20 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:21.789211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:21.789842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:21.796255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:21.796699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:21.797530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:21.797964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:21.925684 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:21.933967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:21.935571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:21.936722 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d7b76d27-36df-4f08-adb3-cdc44fa87364 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.151698 May 24 13:05:21.937268 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 281/571] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:21 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:22.957990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:22.958625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:22.965088 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:22.965541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:22.966358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:22.966793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:23.095882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:23.104258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:23.105747 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:23.106914 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-52a9a5f2-a86f-4e2b-b29e-a0bb675e3cb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.155251 May 24 13:05:23.107469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 291/572] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:22 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:24.124831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:24.125451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:24.132367 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:24.132816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:24.133598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:24.134037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:24.327959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:24.336758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:24.338275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:24.339449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-57ffcd1c-9670-46f1-943b-701f61fbc7dd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.218479 May 24 13:05:24.340002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 282/573] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:24 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:25.357040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:25.357632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:25.363906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:25.364351 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:25.365109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:25.365539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:25.490995 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:25.499279 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:25.500785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:25.502477 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9bb55970-5d54-4ece-9a81-a2e6bbe3c4c6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.149265 May 24 13:05:25.503064 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 292/574] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:25 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:26.521352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:26.521958 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:26.524299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:26.529901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:26.530383 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:26.531141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:26.531575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:26.659121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:26.667428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:26.668928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:26.670076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d50316d9-9752-42cb-a9a7-558191a0d5cd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.153144 May 24 13:05:26.670715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 283/575] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:26 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:27.688086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:27.688717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:27.694708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:27.695147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:27.695898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:27.696326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:27.821085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:27.829445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:27.831507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:27.832663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-44497072-5f42-4cbd-a3e2-5f7113f498f1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.148468 May 24 13:05:27.833232 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 293/576] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:27 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:28.850930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:28.851536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:28.857926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:28.858405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:28.859153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:28.859578 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:28.983559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:28.993124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:28.994636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:28.995770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-406337b9-5e07-4306-814e-7f2d7ec62d66 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.148798 May 24 13:05:28.996326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 284/577] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:28 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:30.013325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:30.013845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:30.019862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:30.020300 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:30.021051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:30.021482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:30.151441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:30.160315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:30.161799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:30.162970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d847e189-9375-4dca-a585-ca4ede2cb235 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.153597 May 24 13:05:30.163521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 294/578] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:30 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:31.180975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:31.181574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:31.188161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:31.188608 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:31.189432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:31.189844 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:31.315309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:31.323575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:31.325043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:31.326176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fe6fbe7e-2b61-47e1-a329-24be2ce88f64 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.149087 May 24 13:05:31.326757 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 285/579] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:31 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:05:32.344705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:32.345314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:32.351447 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:32.351899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:32.352673 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:32.353116 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:32.492324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:32.500732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:32.502254 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:32.503424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-beab9c3c-c47c-4afe-8726-e67bbb47c97d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.163135 May 24 13:05:32.503974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 295/580] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:32 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:33.523143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:33.524180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:33.531750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:33.532195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:33.532951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:33.533376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:33.668473 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:33.677678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:33.679074 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:33.680245 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1774e300-2000-47ca-a8f0-a203d96aa720 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.162891 May 24 13:05:33.680802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 286/581] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:33 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:34.287426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-738f2f58-bd41-4644-a9c7-8ceb6c5a6234 req-8af9854c-daa1-4a23-84cd-64fc0634da0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dbd25ed-5661-4c08-949c-27204c6c1172", "name": "network-vif-plugged", "status": "completed", "tag": "d4232814-2adb-4fc6-bd44-4cb7c7da4de1"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:05:34.291708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=32 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:34.297813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-738f2f58-bd41-4644-a9c7-8ceb6c5a6234 req-8af9854c-daa1-4a23-84cd-64fc0634da0b service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:34.299644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-738f2f58-bd41-4644-a9c7-8ceb6c5a6234 req-8af9854c-daa1-4a23-84cd-64fc0634da0b service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:34.312105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-738f2f58-bd41-4644-a9c7-8ceb6c5a6234 req-8af9854c-daa1-4a23-84cd-64fc0634da0b service nova] Creating event network-vif-plugged:d4232814-2adb-4fc6-bd44-4cb7c7da4de1 for instance 8dbd25ed-5661-4c08-949c-27204c6c1172 on hv-cinder-84301 May 24 13:05:34.317410 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-738f2f58-bd41-4644-a9c7-8ceb6c5a6234 req-8af9854c-daa1-4a23-84cd-64fc0634da0b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034356 May 24 13:05:34.318024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 296/582] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:05:34.621219 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6a4a34cd-49ca-4397-9ff1-edae85ee3cc9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bfe5ed0-b50c-4968-a926-e19bf39d743c"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:05:34.622371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6a4a34cd-49ca-4397-9ff1-edae85ee3cc9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:34.629167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a4a34cd-49ca-4397-9ff1-edae85ee3cc9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:34.629621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a4a34cd-49ca-4397-9ff1-edae85ee3cc9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:34.630448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a4a34cd-49ca-4397-9ff1-edae85ee3cc9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:34.630895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a4a34cd-49ca-4397-9ff1-edae85ee3cc9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:34.634632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:34.699316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:34.700102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:34.707935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:34.708404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:34.709874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:34.710343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:34.859396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:34.869543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:34.872007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:34.874103 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-08be73da-b2e8-4edf-9d2e-23c67d93a8fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.178798 May 24 13:05:34.880282 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 297/583] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:34 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:05:34.913805 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6a4a34cd-49ca-4397-9ff1-edae85ee3cc9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393961 May 24 13:05:34.914472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 287/584] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 13:05:34 2022] POST /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:05:35.893105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:35.893755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:35.899968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:35.900414 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:35.901174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:35.901608 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:36.031554 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:36.039995 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:36.041544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:36.043497 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-46902179-cd79-4787-8698-c918bd957318 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.154301 May 24 13:05:36.043823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 298/585] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:35 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:05:37.065305 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:37.066100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:37.079821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:37.081173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:37.082221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:37.082921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:37.225399 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:37.233903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:37.235433 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:37.236701 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3cb96457-d4c8-493b-a011-5f1b76be9ed2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1808 microversion: 2.20 time: 0.176500 May 24 13:05:37.237866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 288/586] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:37 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:38.254546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:38.255157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:38.262276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:38.262755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:38.263515 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:38.263958 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:38.398769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:38.407404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:38.409383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:38.410638 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-04859e10-2c16-43a3-ad9a-1ec8c8d35836 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1795 microversion: 2.20 time: 0.159976 May 24 13:05:38.411189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 299/587] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:05:38 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:05:42.435495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-77a8f274-5758-434b-af7b-3a962b7dd227 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:05:42.436600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-77a8f274-5758-434b-af7b-3a962b7dd227 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:42.444311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77a8f274-5758-434b-af7b-3a962b7dd227 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:42.444698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77a8f274-5758-434b-af7b-3a962b7dd227 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:42.445444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77a8f274-5758-434b-af7b-3a962b7dd227 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:42.445899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77a8f274-5758-434b-af7b-3a962b7dd227 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:42.467974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-77a8f274-5758-434b-af7b-3a962b7dd227 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lazy-loading 'flavor' on Instance uuid 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:05:42.590566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-77a8f274-5758-434b-af7b-3a962b7dd227 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/action" status: 200 len: 32 microversion: 2.1 time: 0.158860 May 24 13:05:42.591321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 289/588] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:05:42 2022] POST /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 13:05:42.600927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7491ec21-2aa7-4862-8d97-fba5c710a318 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:42.601689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7491ec21-2aa7-4862-8d97-fba5c710a318 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:42.608303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7491ec21-2aa7-4862-8d97-fba5c710a318 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:42.608756 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7491ec21-2aa7-4862-8d97-fba5c710a318 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:42.609723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7491ec21-2aa7-4862-8d97-fba5c710a318 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:42.610172 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7491ec21-2aa7-4862-8d97-fba5c710a318 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:42.738633 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7491ec21-2aa7-4862-8d97-fba5c710a318 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:42.746913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7491ec21-2aa7-4862-8d97-fba5c710a318 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.149913 May 24 13:05:42.747503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 300/589] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:42 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:43.764819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-47e3ad62-6291-41f9-9c58-fb2ff263cf51 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:43.765512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-47e3ad62-6291-41f9-9c58-fb2ff263cf51 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:43.772231 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47e3ad62-6291-41f9-9c58-fb2ff263cf51 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:43.772670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47e3ad62-6291-41f9-9c58-fb2ff263cf51 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:43.773432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47e3ad62-6291-41f9-9c58-fb2ff263cf51 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:43.773862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47e3ad62-6291-41f9-9c58-fb2ff263cf51 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:43.903939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-47e3ad62-6291-41f9-9c58-fb2ff263cf51 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:43.911821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-47e3ad62-6291-41f9-9c58-fb2ff263cf51 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.151490 May 24 13:05:43.912376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 290/590] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:43 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:44.929095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-66e8925e-9ad6-4a41-bff2-1540967bcfb7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:44.929709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-66e8925e-9ad6-4a41-bff2-1540967bcfb7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:44.935785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66e8925e-9ad6-4a41-bff2-1540967bcfb7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:44.936242 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66e8925e-9ad6-4a41-bff2-1540967bcfb7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:44.937005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66e8925e-9ad6-4a41-bff2-1540967bcfb7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:44.937456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66e8925e-9ad6-4a41-bff2-1540967bcfb7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:45.059671 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-66e8925e-9ad6-4a41-bff2-1540967bcfb7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:45.068097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-66e8925e-9ad6-4a41-bff2-1540967bcfb7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.142876 May 24 13:05:45.068668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 301/591] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:44 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:46.085353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2ef3cca2-fb3f-4add-8bc6-57ea7ba56bfb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:46.085961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2ef3cca2-fb3f-4add-8bc6-57ea7ba56bfb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:46.092550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ef3cca2-fb3f-4add-8bc6-57ea7ba56bfb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:46.092995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ef3cca2-fb3f-4add-8bc6-57ea7ba56bfb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:46.093747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ef3cca2-fb3f-4add-8bc6-57ea7ba56bfb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:46.094176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ef3cca2-fb3f-4add-8bc6-57ea7ba56bfb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:46.223943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2ef3cca2-fb3f-4add-8bc6-57ea7ba56bfb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:46.231910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2ef3cca2-fb3f-4add-8bc6-57ea7ba56bfb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.150315 May 24 13:05:46.232473 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 291/592] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:46 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:47.249161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-aa5a8267-a3a0-4123-a730-272c76cb6c0f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:47.249698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-aa5a8267-a3a0-4123-a730-272c76cb6c0f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:47.256211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa5a8267-a3a0-4123-a730-272c76cb6c0f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:47.256651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa5a8267-a3a0-4123-a730-272c76cb6c0f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:47.257408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa5a8267-a3a0-4123-a730-272c76cb6c0f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:47.257838 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa5a8267-a3a0-4123-a730-272c76cb6c0f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:47.385395 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-aa5a8267-a3a0-4123-a730-272c76cb6c0f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:47.394072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-aa5a8267-a3a0-4123-a730-272c76cb6c0f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.148856 May 24 13:05:47.394667 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 302/593] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:47 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:48.410823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d6ed0f79-b4bd-418b-9124-b33d6a77017c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:48.411438 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d6ed0f79-b4bd-418b-9124-b33d6a77017c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:48.417916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6ed0f79-b4bd-418b-9124-b33d6a77017c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:48.418389 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6ed0f79-b4bd-418b-9124-b33d6a77017c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:48.419173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6ed0f79-b4bd-418b-9124-b33d6a77017c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:48.419609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6ed0f79-b4bd-418b-9124-b33d6a77017c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:48.550186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d6ed0f79-b4bd-418b-9124-b33d6a77017c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:48.558043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d6ed0f79-b4bd-418b-9124-b33d6a77017c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.151688 May 24 13:05:48.558705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 292/594] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:48 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:49.575596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6154d2c7-e02a-4813-bbc2-8d69553bffcd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:49.576207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6154d2c7-e02a-4813-bbc2-8d69553bffcd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:49.582837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6154d2c7-e02a-4813-bbc2-8d69553bffcd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:49.583281 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6154d2c7-e02a-4813-bbc2-8d69553bffcd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:49.584031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6154d2c7-e02a-4813-bbc2-8d69553bffcd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:49.584463 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6154d2c7-e02a-4813-bbc2-8d69553bffcd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:49.707159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6154d2c7-e02a-4813-bbc2-8d69553bffcd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:49.714993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6154d2c7-e02a-4813-bbc2-8d69553bffcd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.143318 May 24 13:05:49.715547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 303/595] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:49 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:50.731717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b4ba31ae-82b9-400f-9a4f-c1c7fb6ae2c3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:50.732256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b4ba31ae-82b9-400f-9a4f-c1c7fb6ae2c3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:50.739841 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4ba31ae-82b9-400f-9a4f-c1c7fb6ae2c3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:50.740539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4ba31ae-82b9-400f-9a4f-c1c7fb6ae2c3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:50.741285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4ba31ae-82b9-400f-9a4f-c1c7fb6ae2c3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:50.741714 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4ba31ae-82b9-400f-9a4f-c1c7fb6ae2c3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:50.868026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b4ba31ae-82b9-400f-9a4f-c1c7fb6ae2c3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:50.875922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b4ba31ae-82b9-400f-9a4f-c1c7fb6ae2c3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.148068 May 24 13:05:50.876476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 293/596] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:50 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:51.893508 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9a4a2d46-de01-45fe-8107-af111f9ba9b7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:51.894119 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9a4a2d46-de01-45fe-8107-af111f9ba9b7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:51.900095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9a4a2d46-de01-45fe-8107-af111f9ba9b7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:51.900535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9a4a2d46-de01-45fe-8107-af111f9ba9b7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:51.901284 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9a4a2d46-de01-45fe-8107-af111f9ba9b7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:51.901714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9a4a2d46-de01-45fe-8107-af111f9ba9b7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:51.904312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=80 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:52.030759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9a4a2d46-de01-45fe-8107-af111f9ba9b7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:52.038693 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9a4a2d46-de01-45fe-8107-af111f9ba9b7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.149785 May 24 13:05:52.039257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 304/597] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:51 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:53.055537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-807419d9-293a-4ddc-be42-a191d27541dd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:53.056110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-807419d9-293a-4ddc-be42-a191d27541dd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:53.062731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-807419d9-293a-4ddc-be42-a191d27541dd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:53.063185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-807419d9-293a-4ddc-be42-a191d27541dd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:53.064443 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-807419d9-293a-4ddc-be42-a191d27541dd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:53.064883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-807419d9-293a-4ddc-be42-a191d27541dd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:53.192498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-807419d9-293a-4ddc-be42-a191d27541dd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:53.200418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-807419d9-293a-4ddc-be42-a191d27541dd tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.148827 May 24 13:05:53.200982 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 294/598] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:53 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:54.218158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c596388a-6027-42e8-89f7-3642a987846a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:54.218767 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c596388a-6027-42e8-89f7-3642a987846a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:54.232316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c596388a-6027-42e8-89f7-3642a987846a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:54.232773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c596388a-6027-42e8-89f7-3642a987846a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:54.233547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c596388a-6027-42e8-89f7-3642a987846a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:54.233993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c596388a-6027-42e8-89f7-3642a987846a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:54.358770 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c596388a-6027-42e8-89f7-3642a987846a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:54.367755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c596388a-6027-42e8-89f7-3642a987846a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.153364 May 24 13:05:54.368089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 305/599] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:54 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:55.385133 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6126fada-5d8f-4194-8fb5-6724bafcc55f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:55.385743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6126fada-5d8f-4194-8fb5-6724bafcc55f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:55.392300 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6126fada-5d8f-4194-8fb5-6724bafcc55f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:55.392742 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6126fada-5d8f-4194-8fb5-6724bafcc55f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:55.393501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6126fada-5d8f-4194-8fb5-6724bafcc55f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:55.393933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6126fada-5d8f-4194-8fb5-6724bafcc55f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:55.520475 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6126fada-5d8f-4194-8fb5-6724bafcc55f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:55.528526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6126fada-5d8f-4194-8fb5-6724bafcc55f tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.147072 May 24 13:05:55.529083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 295/600] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:55 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:56.545944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-78444567-3dc3-4478-aa7a-df2735065bda tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:56.546591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-78444567-3dc3-4478-aa7a-df2735065bda tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:56.552991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-78444567-3dc3-4478-aa7a-df2735065bda tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:56.553447 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-78444567-3dc3-4478-aa7a-df2735065bda tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:56.554201 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-78444567-3dc3-4478-aa7a-df2735065bda tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:56.554662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-78444567-3dc3-4478-aa7a-df2735065bda tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:56.689027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-78444567-3dc3-4478-aa7a-df2735065bda tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:56.697090 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-78444567-3dc3-4478-aa7a-df2735065bda tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1736 microversion: 2.1 time: 0.155088 May 24 13:05:56.697652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 306/601] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:56 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:57.714339 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-64283412-0629-43f9-87f1-e0880477537c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:57.714978 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-64283412-0629-43f9-87f1-e0880477537c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:57.717450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=26 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:57.723669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64283412-0629-43f9-87f1-e0880477537c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:57.724112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64283412-0629-43f9-87f1-e0880477537c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:57.724865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64283412-0629-43f9-87f1-e0880477537c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:57.725294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64283412-0629-43f9-87f1-e0880477537c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:57.853234 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-64283412-0629-43f9-87f1-e0880477537c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:57.861576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-64283412-0629-43f9-87f1-e0880477537c tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1716 microversion: 2.1 time: 0.151102 May 24 13:05:57.862132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 296/602] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:57 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:57.915367 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:57.915886 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:57.921930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:57.922408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:57.923192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:57.923620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:58.043200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] HTTP exception thrown: Cannot 'detach_volume' instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 while it is in vm_state rescued May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Request method failure captured: May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: DELETE /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments/7bfe5ed0-b50c-4968-a926-e19bf39d743c HTTP/1.1 May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbk1m2T0FVB_cowxlzFZQfSHOpRVI9qCWVHjb_tithLQX15Ze6FudOun7uaWC1WgdzOGlkCCMv9N7uEpRLg0FHpv0Qtqjx_79FscW-065fahLrq7wPXW2IVrIkFc2ISrVCiR1ErbpQ1shxRRVCO35nu5BuuLWvvWyK8OB9kj9ByHGI May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:05:58.044790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 91a76f7af8a5467bbf567ca5b9db9ce0 May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:05:58.046408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Cannot 'detach_volume' instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 while it is in vm_state rescued May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'server_id': '968b8af5-f426-4c06-bf8a-fd06bc9e71d7', 'id': '7bfe5ed0-b50c-4968-a926-e19bf39d743c'} May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:05:58.047175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 while it is in vm_state rescued May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 while it is in vm_state rescued May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:05:58.049133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Returning 409 to user: Cannot 'detach_volume' instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 while it is in vm_state rescued {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:05:58.050362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9d582ffe-9814-4e9c-9af0-b90695b9e494 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "DELETE /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments/7bfe5ed0-b50c-4968-a926-e19bf39d743c" status: 409 len: 152 microversion: 2.1 time: 0.134782 May 24 13:05:58.050362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 307/603] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 13:05:57 2022] DELETE /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments/7bfe5ed0-b50c-4968-a926-e19bf39d743c => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 13:05:58.055658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3c57622e-7d48-4da0-8fe7-b17079be75f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:05:58.056312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c57622e-7d48-4da0-8fe7-b17079be75f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:58.062227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c57622e-7d48-4da0-8fe7-b17079be75f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:58.062727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c57622e-7d48-4da0-8fe7-b17079be75f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:58.063490 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c57622e-7d48-4da0-8fe7-b17079be75f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:58.064490 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c57622e-7d48-4da0-8fe7-b17079be75f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:58.128395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3c57622e-7d48-4da0-8fe7-b17079be75f6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "POST /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/action" status: 202 len: 0 microversion: 2.1 time: 0.076354 May 24 13:05:58.131971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 297/604] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:05:58 2022] POST /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:05:58.137152 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-de0a48a1-576f-4439-a941-839061f482f8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:58.137770 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-de0a48a1-576f-4439-a941-839061f482f8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:58.144543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de0a48a1-576f-4439-a941-839061f482f8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:58.144998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de0a48a1-576f-4439-a941-839061f482f8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:58.145767 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de0a48a1-576f-4439-a941-839061f482f8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:58.146231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de0a48a1-576f-4439-a941-839061f482f8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:58.279467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-de0a48a1-576f-4439-a941-839061f482f8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:58.287949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-de0a48a1-576f-4439-a941-839061f482f8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1724 microversion: 2.1 time: 0.154512 May 24 13:05:58.288468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 308/605] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:58 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:05:59.306297 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0f40173c-e08e-4f52-91d4-4720e88ed075 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:59.307021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0f40173c-e08e-4f52-91d4-4720e88ed075 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:59.313282 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f40173c-e08e-4f52-91d4-4720e88ed075 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:59.314232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f40173c-e08e-4f52-91d4-4720e88ed075 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:59.315018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f40173c-e08e-4f52-91d4-4720e88ed075 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:59.315457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f40173c-e08e-4f52-91d4-4720e88ed075 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:59.442922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0f40173c-e08e-4f52-91d4-4720e88ed075 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:05:59.450913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0f40173c-e08e-4f52-91d4-4720e88ed075 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1724 microversion: 2.1 time: 0.149334 May 24 13:05:59.451487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 298/606] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:05:59 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:05:59.635044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c2d25c9f-3795-44b6-a72f-114a07141a7f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:05:59.635705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c2d25c9f-3795-44b6-a72f-114a07141a7f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:05:59.642018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c2d25c9f-3795-44b6-a72f-114a07141a7f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:59.642514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c2d25c9f-3795-44b6-a72f-114a07141a7f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:59.643275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c2d25c9f-3795-44b6-a72f-114a07141a7f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:05:59.643839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c2d25c9f-3795-44b6-a72f-114a07141a7f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:05:59.722453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-c2d25c9f-3795-44b6-a72f-114a07141a7f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lazy-loading 'services' on Instance uuid dc6db3c9-4cac-4157-ba43-3c425854302d {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:05:59.837412 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c2d25c9f-3795-44b6-a72f-114a07141a7f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/os-volume_attachments/d99c90be-8355-4062-989d-01dfd027293c" status: 202 len: 0 microversion: 2.1 time: 0.307960 May 24 13:05:59.838010 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 309/607] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 13:05:59 2022] DELETE /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/os-volume_attachments/d99c90be-8355-4062-989d-01dfd027293c => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:06:00.468315 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9be27378-4dee-4eee-9e99-bd6f0b29fc87 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:00.468949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9be27378-4dee-4eee-9e99-bd6f0b29fc87 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:00.476147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9be27378-4dee-4eee-9e99-bd6f0b29fc87 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:00.476596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9be27378-4dee-4eee-9e99-bd6f0b29fc87 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:00.477358 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9be27378-4dee-4eee-9e99-bd6f0b29fc87 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:00.477793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9be27378-4dee-4eee-9e99-bd6f0b29fc87 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:00.494611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:00.606277 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9be27378-4dee-4eee-9e99-bd6f0b29fc87 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:00.621210 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9be27378-4dee-4eee-9e99-bd6f0b29fc87 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1724 microversion: 2.1 time: 0.156709 May 24 13:06:00.621766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 299/608] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:00 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:01.644830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d3ac3f62-829f-42c6-8cee-f0d24edd2b4d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:01.645526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d3ac3f62-829f-42c6-8cee-f0d24edd2b4d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:01.651832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3ac3f62-829f-42c6-8cee-f0d24edd2b4d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:01.652280 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3ac3f62-829f-42c6-8cee-f0d24edd2b4d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:01.653030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3ac3f62-829f-42c6-8cee-f0d24edd2b4d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:01.653467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3ac3f62-829f-42c6-8cee-f0d24edd2b4d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:01.783880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d3ac3f62-829f-42c6-8cee-f0d24edd2b4d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:01.791749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d3ac3f62-829f-42c6-8cee-f0d24edd2b4d tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1730 microversion: 2.1 time: 0.151695 May 24 13:06:01.792307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 310/609] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:01 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:01.807733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-96ab30b1-46cc-4bd9-bf33-36a30def01a9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:01.808221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-96ab30b1-46cc-4bd9-bf33-36a30def01a9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:01.814796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96ab30b1-46cc-4bd9-bf33-36a30def01a9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:01.815247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96ab30b1-46cc-4bd9-bf33-36a30def01a9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:01.816016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96ab30b1-46cc-4bd9-bf33-36a30def01a9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:01.816453 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96ab30b1-46cc-4bd9-bf33-36a30def01a9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:02.105633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-96ab30b1-46cc-4bd9-bf33-36a30def01a9 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.301553 May 24 13:06:02.106224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 300/610] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 13:06:01 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-interface => generated 285 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:06:03.015984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-156dbad7-6082-4a9c-a282-cf61d3925c2a req-363415c3-e54e-44fa-b508-4577087fb5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968b8af5-f426-4c06-bf8a-fd06bc9e71d7", "tag": "98ea03b5-b5f4-4953-9488-c61cc24f6125"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:03.025521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-156dbad7-6082-4a9c-a282-cf61d3925c2a req-363415c3-e54e-44fa-b508-4577087fb5fc service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:03.025968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-156dbad7-6082-4a9c-a282-cf61d3925c2a req-363415c3-e54e-44fa-b508-4577087fb5fc service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:03.037004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-156dbad7-6082-4a9c-a282-cf61d3925c2a req-363415c3-e54e-44fa-b508-4577087fb5fc service nova] Creating event network-changed:98ea03b5-b5f4-4953-9488-c61cc24f6125 for instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 on hv-cinder-84301 May 24 13:06:03.042609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-156dbad7-6082-4a9c-a282-cf61d3925c2a req-363415c3-e54e-44fa-b508-4577087fb5fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089600 May 24 13:06:03.043208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 311/611] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:06:03.066331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a4a61750-1a1f-45a1-b8f0-9e7bb118f33c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:03.073138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4a61750-1a1f-45a1-b8f0-9e7bb118f33c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:03.073589 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4a61750-1a1f-45a1-b8f0-9e7bb118f33c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:03.096338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a4a61750-1a1f-45a1-b8f0-9e7bb118f33c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Going to try to stop instance {{(pid=117642) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 13:06:03.140072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a4a61750-1a1f-45a1-b8f0-9e7bb118f33c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/action" status: 202 len: 0 microversion: 2.1 time: 0.078452 May 24 13:06:03.140985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 301/612] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:06:03 2022] POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:06:03.151990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cf89c378-fd67-4d94-9e3b-8c969d5f1e03 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:03.153064 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cf89c378-fd67-4d94-9e3b-8c969d5f1e03 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:03.160602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf89c378-fd67-4d94-9e3b-8c969d5f1e03 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:03.161322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf89c378-fd67-4d94-9e3b-8c969d5f1e03 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:03.162505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf89c378-fd67-4d94-9e3b-8c969d5f1e03 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:03.163139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf89c378-fd67-4d94-9e3b-8c969d5f1e03 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:03.307206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cf89c378-fd67-4d94-9e3b-8c969d5f1e03 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:03.316146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cf89c378-fd67-4d94-9e3b-8c969d5f1e03 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.170020 May 24 13:06:03.317163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 312/613] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:03 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:04.340239 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-64e4326f-e354-40b6-9476-5d4da0995c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:04.340936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-64e4326f-e354-40b6-9476-5d4da0995c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:04.347166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64e4326f-e354-40b6-9476-5d4da0995c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:04.347623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64e4326f-e354-40b6-9476-5d4da0995c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:04.348393 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64e4326f-e354-40b6-9476-5d4da0995c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:04.348829 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64e4326f-e354-40b6-9476-5d4da0995c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:04.480567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-64e4326f-e354-40b6-9476-5d4da0995c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:04.488090 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-64e4326f-e354-40b6-9476-5d4da0995c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.152526 May 24 13:06:04.488651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 302/614] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:04 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:05.056918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-6201108a-b997-4490-add5-aff5e6a98c09 req-93b56ff0-22fd-4822-97d0-65030ea26f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968b8af5-f426-4c06-bf8a-fd06bc9e71d7", "tag": "98ea03b5-b5f4-4953-9488-c61cc24f6125"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:05.060421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=34 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:05.066569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-6201108a-b997-4490-add5-aff5e6a98c09 req-93b56ff0-22fd-4822-97d0-65030ea26f8b service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:05.067048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-6201108a-b997-4490-add5-aff5e6a98c09 req-93b56ff0-22fd-4822-97d0-65030ea26f8b service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:05.078159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-6201108a-b997-4490-add5-aff5e6a98c09 req-93b56ff0-22fd-4822-97d0-65030ea26f8b service nova] Creating event network-changed:98ea03b5-b5f4-4953-9488-c61cc24f6125 for instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 on hv-cinder-84301 May 24 13:06:05.083951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-6201108a-b997-4490-add5-aff5e6a98c09 req-93b56ff0-22fd-4822-97d0-65030ea26f8b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030636 May 24 13:06:05.084557 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 313/615] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:06:05.504924 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2b20c532-28e9-4e2a-94dd-9f9306c0945b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:05.505543 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2b20c532-28e9-4e2a-94dd-9f9306c0945b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:05.512050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b20c532-28e9-4e2a-94dd-9f9306c0945b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:05.512495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b20c532-28e9-4e2a-94dd-9f9306c0945b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:05.513291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b20c532-28e9-4e2a-94dd-9f9306c0945b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:05.513727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b20c532-28e9-4e2a-94dd-9f9306c0945b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:05.717954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2b20c532-28e9-4e2a-94dd-9f9306c0945b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:05.726338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2b20c532-28e9-4e2a-94dd-9f9306c0945b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.225216 May 24 13:06:05.726915 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 303/616] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:05 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:06.744409 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-94fc33b4-2f03-47ea-99db-c1b75429e2b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:06.745062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-94fc33b4-2f03-47ea-99db-c1b75429e2b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:06.752410 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94fc33b4-2f03-47ea-99db-c1b75429e2b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:06.752861 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94fc33b4-2f03-47ea-99db-c1b75429e2b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:06.753616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94fc33b4-2f03-47ea-99db-c1b75429e2b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:06.754058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94fc33b4-2f03-47ea-99db-c1b75429e2b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:06.880260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-94fc33b4-2f03-47ea-99db-c1b75429e2b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:06.887778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-94fc33b4-2f03-47ea-99db-c1b75429e2b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.148226 May 24 13:06:06.888354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 314/617] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:06 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:07.904950 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-661d7dd3-61ac-4d80-bdad-d489183eb3d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:07.905572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-661d7dd3-61ac-4d80-bdad-d489183eb3d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:07.912677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-661d7dd3-61ac-4d80-bdad-d489183eb3d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:07.913134 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-661d7dd3-61ac-4d80-bdad-d489183eb3d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:07.913902 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-661d7dd3-61ac-4d80-bdad-d489183eb3d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:07.914574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-661d7dd3-61ac-4d80-bdad-d489183eb3d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:08.055541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-661d7dd3-61ac-4d80-bdad-d489183eb3d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:08.063075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-661d7dd3-61ac-4d80-bdad-d489183eb3d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.162076 May 24 13:06:08.063642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 304/618] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:07 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:09.081629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a1ac1452-6646-4275-bffd-c87c95c34244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:09.082235 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a1ac1452-6646-4275-bffd-c87c95c34244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:09.088820 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a1ac1452-6646-4275-bffd-c87c95c34244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:09.089270 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a1ac1452-6646-4275-bffd-c87c95c34244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:09.090065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a1ac1452-6646-4275-bffd-c87c95c34244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:09.090540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a1ac1452-6646-4275-bffd-c87c95c34244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:09.226457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a1ac1452-6646-4275-bffd-c87c95c34244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:09.233956 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a1ac1452-6646-4275-bffd-c87c95c34244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.156945 May 24 13:06:09.234552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 315/619] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:09 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:10.251126 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ff12dea8-a1c7-4c6f-91d4-b1bf71fa6087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:10.251739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ff12dea8-a1c7-4c6f-91d4-b1bf71fa6087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:10.258274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff12dea8-a1c7-4c6f-91d4-b1bf71fa6087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:10.258747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff12dea8-a1c7-4c6f-91d4-b1bf71fa6087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:10.259511 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff12dea8-a1c7-4c6f-91d4-b1bf71fa6087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:10.260025 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff12dea8-a1c7-4c6f-91d4-b1bf71fa6087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:10.395638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff12dea8-a1c7-4c6f-91d4-b1bf71fa6087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:10.403195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ff12dea8-a1c7-4c6f-91d4-b1bf71fa6087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.155905 May 24 13:06:10.403753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 305/620] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:10 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:11.420684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-56a274d0-59e2-4802-8032-a5da88378be8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:11.421341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-56a274d0-59e2-4802-8032-a5da88378be8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:11.428024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56a274d0-59e2-4802-8032-a5da88378be8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:11.428480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56a274d0-59e2-4802-8032-a5da88378be8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:11.429243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56a274d0-59e2-4802-8032-a5da88378be8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:11.429683 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56a274d0-59e2-4802-8032-a5da88378be8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:11.556535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-56a274d0-59e2-4802-8032-a5da88378be8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:11.564020 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-56a274d0-59e2-4802-8032-a5da88378be8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.147156 May 24 13:06:11.565188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 316/621] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:11 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:12.581953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-37dd6a3f-01d1-4c20-87e4-77c66f2e6a23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:12.582590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-37dd6a3f-01d1-4c20-87e4-77c66f2e6a23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:12.589111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-37dd6a3f-01d1-4c20-87e4-77c66f2e6a23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:12.589559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-37dd6a3f-01d1-4c20-87e4-77c66f2e6a23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:12.590337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-37dd6a3f-01d1-4c20-87e4-77c66f2e6a23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:12.590773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-37dd6a3f-01d1-4c20-87e4-77c66f2e6a23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:12.722650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-37dd6a3f-01d1-4c20-87e4-77c66f2e6a23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:12.730075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-37dd6a3f-01d1-4c20-87e4-77c66f2e6a23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.152590 May 24 13:06:12.730664 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 306/622] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:12 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:13.747071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dc736164-7b52-467e-988f-bf585e6b967e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:13.747682 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dc736164-7b52-467e-988f-bf585e6b967e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:13.754078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc736164-7b52-467e-988f-bf585e6b967e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:13.754559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc736164-7b52-467e-988f-bf585e6b967e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:13.755313 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc736164-7b52-467e-988f-bf585e6b967e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:13.755741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc736164-7b52-467e-988f-bf585e6b967e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:13.892949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dc736164-7b52-467e-988f-bf585e6b967e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:13.900621 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dc736164-7b52-467e-988f-bf585e6b967e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.157416 May 24 13:06:13.901279 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 317/623] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:13 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:14.919326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b6a26b82-0951-49b2-95c4-e5e203f41fb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:14.919936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b6a26b82-0951-49b2-95c4-e5e203f41fb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:14.927134 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6a26b82-0951-49b2-95c4-e5e203f41fb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:14.927579 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6a26b82-0951-49b2-95c4-e5e203f41fb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:14.928325 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6a26b82-0951-49b2-95c4-e5e203f41fb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:14.928761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6a26b82-0951-49b2-95c4-e5e203f41fb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:15.053240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b6a26b82-0951-49b2-95c4-e5e203f41fb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:15.060776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b6a26b82-0951-49b2-95c4-e5e203f41fb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.145255 May 24 13:06:15.061544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 307/624] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:14 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:16.077206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3d28504e-0acb-450c-b9ce-b212342c9a37 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:16.077809 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3d28504e-0acb-450c-b9ce-b212342c9a37 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:16.083738 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d28504e-0acb-450c-b9ce-b212342c9a37 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:16.084182 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d28504e-0acb-450c-b9ce-b212342c9a37 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:16.084932 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d28504e-0acb-450c-b9ce-b212342c9a37 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:16.085359 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d28504e-0acb-450c-b9ce-b212342c9a37 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:16.214372 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3d28504e-0acb-450c-b9ce-b212342c9a37 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:16.222224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3d28504e-0acb-450c-b9ce-b212342c9a37 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.148808 May 24 13:06:16.222816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 318/625] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:16 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:17.239254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f451740a-a110-4bf0-93a3-f36a294572b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:17.240199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f451740a-a110-4bf0-93a3-f36a294572b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:17.246620 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f451740a-a110-4bf0-93a3-f36a294572b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:17.247068 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f451740a-a110-4bf0-93a3-f36a294572b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:17.247820 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f451740a-a110-4bf0-93a3-f36a294572b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:17.248273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f451740a-a110-4bf0-93a3-f36a294572b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:17.377608 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f451740a-a110-4bf0-93a3-f36a294572b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:17.385186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f451740a-a110-4bf0-93a3-f36a294572b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.149720 May 24 13:06:17.385930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 308/626] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:17 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:18.403187 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-744cd93b-c47b-44ee-97b6-6e93b6c6437a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:18.403798 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-744cd93b-c47b-44ee-97b6-6e93b6c6437a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:18.410565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-744cd93b-c47b-44ee-97b6-6e93b6c6437a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:18.411044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-744cd93b-c47b-44ee-97b6-6e93b6c6437a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:18.411824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-744cd93b-c47b-44ee-97b6-6e93b6c6437a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:18.412258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-744cd93b-c47b-44ee-97b6-6e93b6c6437a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:18.539129 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-744cd93b-c47b-44ee-97b6-6e93b6c6437a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:18.546702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-744cd93b-c47b-44ee-97b6-6e93b6c6437a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1678 microversion: 2.1 time: 0.147400 May 24 13:06:18.547289 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 319/627] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:18 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:19.563811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ce13e5bb-87b5-4f6e-88dd-b329eed5264c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:19.564464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ce13e5bb-87b5-4f6e-88dd-b329eed5264c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:19.571093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce13e5bb-87b5-4f6e-88dd-b329eed5264c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:19.571536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce13e5bb-87b5-4f6e-88dd-b329eed5264c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:19.572294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce13e5bb-87b5-4f6e-88dd-b329eed5264c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:19.572718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce13e5bb-87b5-4f6e-88dd-b329eed5264c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:19.697769 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ce13e5bb-87b5-4f6e-88dd-b329eed5264c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:19.705185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ce13e5bb-87b5-4f6e-88dd-b329eed5264c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1655 microversion: 2.1 time: 0.145209 May 24 13:06:19.705753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 309/628] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:19 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:19.721257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5d257ad4-215f-40ae-9e24-5c7af5a525c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:19.727445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d257ad4-215f-40ae-9e24-5c7af5a525c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:19.727891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d257ad4-215f-40ae-9e24-5c7af5a525c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:19.750253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5d257ad4-215f-40ae-9e24-5c7af5a525c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Going to try to start instance {{(pid=117643) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 13:06:19.772234 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:19.792616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5d257ad4-215f-40ae-9e24-5c7af5a525c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/action" status: 202 len: 0 microversion: 2.1 time: 0.075086 May 24 13:06:19.793236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 320/629] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:06:19 2022] POST /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:06:19.801923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d54871c9-55a6-414c-af76-3ef333e9e64f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:19.802567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d54871c9-55a6-414c-af76-3ef333e9e64f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:19.808779 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d54871c9-55a6-414c-af76-3ef333e9e64f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:19.809304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d54871c9-55a6-414c-af76-3ef333e9e64f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:19.810113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d54871c9-55a6-414c-af76-3ef333e9e64f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:19.810660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d54871c9-55a6-414c-af76-3ef333e9e64f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:20.023183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d54871c9-55a6-414c-af76-3ef333e9e64f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:20.030712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d54871c9-55a6-414c-af76-3ef333e9e64f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1664 microversion: 2.1 time: 0.233130 May 24 13:06:20.031281 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 310/630] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:19 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1664 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:21.049315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b4a61641-17f2-461e-a9a8-6da4642f0b23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:21.050014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b4a61641-17f2-461e-a9a8-6da4642f0b23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:21.056255 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b4a61641-17f2-461e-a9a8-6da4642f0b23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:21.056702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b4a61641-17f2-461e-a9a8-6da4642f0b23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:21.057459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b4a61641-17f2-461e-a9a8-6da4642f0b23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:21.057896 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b4a61641-17f2-461e-a9a8-6da4642f0b23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:21.189863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b4a61641-17f2-461e-a9a8-6da4642f0b23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:21.197343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b4a61641-17f2-461e-a9a8-6da4642f0b23 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1668 microversion: 2.1 time: 0.152805 May 24 13:06:21.197908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 321/631] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:21 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:35.545848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3fdc6254-ebb7-484e-a90b-d1a391e76085 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:35.546430 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3fdc6254-ebb7-484e-a90b-d1a391e76085 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:35.549140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=29 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:35.549786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:35.555509 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3fdc6254-ebb7-484e-a90b-d1a391e76085 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:35.555951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3fdc6254-ebb7-484e-a90b-d1a391e76085 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:35.556700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3fdc6254-ebb7-484e-a90b-d1a391e76085 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:35.557123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3fdc6254-ebb7-484e-a90b-d1a391e76085 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:35.589129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3fdc6254-ebb7-484e-a90b-d1a391e76085 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments/b256f919-cbcf-4d7b-9653-d576f9716e09" status: 200 len: 194 microversion: 2.20 time: 0.047293 May 24 13:06:35.589690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 311/632] 10.222.0.45 () {60 vars in 1453 bytes} [Tue May 24 13:06:35 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments/b256f919-cbcf-4d7b-9653-d576f9716e09 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:06:35.652357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0846e755-3ab8-4cda-8017-de31fc119ca5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:35.652845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0846e755-3ab8-4cda-8017-de31fc119ca5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:35.654970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=17 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:35.655780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:35.662075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0846e755-3ab8-4cda-8017-de31fc119ca5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:35.662498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0846e755-3ab8-4cda-8017-de31fc119ca5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:35.663257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0846e755-3ab8-4cda-8017-de31fc119ca5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:35.663693 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0846e755-3ab8-4cda-8017-de31fc119ca5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:35.743774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-0846e755-3ab8-4cda-8017-de31fc119ca5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lazy-loading 'services' on Instance uuid 8dbd25ed-5661-4c08-949c-27204c6c1172 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:06:35.812975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0846e755-3ab8-4cda-8017-de31fc119ca5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments/b256f919-cbcf-4d7b-9653-d576f9716e09" status: 202 len: 0 microversion: 2.20 time: 0.164277 May 24 13:06:35.813598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 322/633] 10.222.0.45 () {60 vars in 1456 bytes} [Tue May 24 13:06:35 2022] DELETE /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments/b256f919-cbcf-4d7b-9653-d576f9716e09 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 13:06:35.821986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-54cf636c-e78e-4b16-9945-0fef523e844e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:35.823063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-54cf636c-e78e-4b16-9945-0fef523e844e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:35.829370 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54cf636c-e78e-4b16-9945-0fef523e844e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:35.829842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54cf636c-e78e-4b16-9945-0fef523e844e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:35.830854 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54cf636c-e78e-4b16-9945-0fef523e844e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:35.831076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54cf636c-e78e-4b16-9945-0fef523e844e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:35.865363 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-54cf636c-e78e-4b16-9945-0fef523e844e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047274 May 24 13:06:35.865918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 312/634] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 13:06:35 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:06:36.878410 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-359b5b95-a7fc-4661-bd08-0734a78add41 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:36.879468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-359b5b95-a7fc-4661-bd08-0734a78add41 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:36.885775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-359b5b95-a7fc-4661-bd08-0734a78add41 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:36.886230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-359b5b95-a7fc-4661-bd08-0734a78add41 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:36.887029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-359b5b95-a7fc-4661-bd08-0734a78add41 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:36.887466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-359b5b95-a7fc-4661-bd08-0734a78add41 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:36.915188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-359b5b95-a7fc-4661-bd08-0734a78add41 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041906 May 24 13:06:36.915734 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 323/635] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 13:06:36 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:36.974662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3567717b-29ce-4485-94e1-b6d929777a7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:36.975172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3567717b-29ce-4485-94e1-b6d929777a7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:36.981813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3567717b-29ce-4485-94e1-b6d929777a7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:36.982263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3567717b-29ce-4485-94e1-b6d929777a7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:36.983055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3567717b-29ce-4485-94e1-b6d929777a7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:36.983491 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3567717b-29ce-4485-94e1-b6d929777a7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:37.010699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3567717b-29ce-4485-94e1-b6d929777a7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:06:37.086630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3567717b-29ce-4485-94e1-b6d929777a7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 204 len: 0 microversion: 2.20 time: 0.115326 May 24 13:06:37.087181 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 313/636] 10.222.0.45 () {60 vars in 1279 bytes} [Tue May 24 13:06:36 2022] DELETE /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 13:06:37.095645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:37.096268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:37.102696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:37.103143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:37.103917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:37.104347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:37.246076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:37.254210 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:37.255727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:37.256873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d566ff72-d1cb-4094-8547-7067d1f841ae tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.165379 May 24 13:06:37.257423 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 324/637] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:37 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:06:38.275547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:38.276246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:38.282679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:38.283169 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:38.283989 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:38.284494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:38.411154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:38.419011 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:38.420545 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:38.421692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-07e68780-4579-4566-a855-b2509b04daf9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.150370 May 24 13:06:38.422245 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 314/638] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:38 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:39.440931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:39.441545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:39.447566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:39.448017 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:39.448773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:39.449208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:39.573798 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:39.582535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:39.584058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:39.585230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2ca1a455-ba04-4ae9-9caa-28db02a3941d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 200 len: 1723 microversion: 2.20 time: 0.148802 May 24 13:06:39.585789 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 325/639] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:39 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:40.110425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-91073be1-f35c-4747-9764-ec2292a6b8f2 req-68a36aac-a170-41e5-bd59-0e0b9478cd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dbd25ed-5661-4c08-949c-27204c6c1172", "name": "network-vif-deleted", "tag": "d4232814-2adb-4fc6-bd44-4cb7c7da4de1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:40.121130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-91073be1-f35c-4747-9764-ec2292a6b8f2 req-68a36aac-a170-41e5-bd59-0e0b9478cd13 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:40.121927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-91073be1-f35c-4747-9764-ec2292a6b8f2 req-68a36aac-a170-41e5-bd59-0e0b9478cd13 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:40.134476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-91073be1-f35c-4747-9764-ec2292a6b8f2 req-68a36aac-a170-41e5-bd59-0e0b9478cd13 service nova] Creating event network-vif-deleted:d4232814-2adb-4fc6-bd44-4cb7c7da4de1 for instance 8dbd25ed-5661-4c08-949c-27204c6c1172 on hv-cinder-84301 May 24 13:06:40.140974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-91073be1-f35c-4747-9764-ec2292a6b8f2 req-68a36aac-a170-41e5-bd59-0e0b9478cd13 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108125 May 24 13:06:40.142897 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 315/640] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:06:40.602650 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:40.603279 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:40.609609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:40.610059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:40.610861 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:40.611297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:40.625718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] HTTP exception thrown: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Request method failure captured: May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 HTTP/1.1 May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbZoQy-eR6FHCFODsrK1xBISdBLWpwyMp6dg7yRQRwGroYtc1-dSGvt5AdTvnp7FEoW1Xyxx5-Kmg0aHlgoIWJlk6ZbcODSL2sqXnQ3_jkyBEaHJuGuLt1dIeCk1FofyWKyjZaTfkIP8sZB7SHcX8royL2ZXZTfs_libM9gJbh_Izg May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Openstack-Nova-Api-Version: 2.20 May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: e57720cd453848a89315ad87ace38161 May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:06:40.628124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e57720cd453848a89315ad87ace38161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e57720cd453848a89315ad87ace38161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: e57720cd453848a89315ad87ace38161 May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: f7b0dfb3d6514817aba4ab34fd972ba1 May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:06:40.629859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '8dbd25ed-5661-4c08-949c-27204c6c1172'} May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:06:40.630830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:06:40.632362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:40.634981 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Returning 404 to user: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:06:40.635839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4f5a81c9-50ba-4327-add3-f2cc93070ef6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 404 len: 111 microversion: 2.20 time: 0.037171 May 24 13:06:40.636398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 326/641] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:40 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 24 13:06:40.645727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-af253b9f-19c7-4ab4-ba37-a34fcf817be5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '.version_select at 0x7f9a66f350d0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:40.679484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-af253b9f-19c7-4ab4-ba37-a34fcf817be5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540075073" status: 204 len: 0 microversion: 2.20 time: 0.038258 May 24 13:06:40.682318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 316/642] 10.222.0.45 () {60 vars in 1258 bytes} [Tue May 24 13:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540075073 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 24 13:06:40.882031 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:06:40.882272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:06:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:06:41.585952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-12d8608c-8c1a-4f77-a8e9-983ad6858337 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'create', calling method: .version_select at 0x7f9a65fc4040>, body: {"keypair": {"name": "tempest-keypair-626728203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPm/BdqAnVHn0gj2+lyQW2Y8GsR9ffrfkCF0Ff7r5s0BS/uMWnBW5GFW0CpEWlWenwmBkVXQ4elBCcXRTseptdK8g1UOPRCrMbdEpzY0vxMtXdIuoTq3y8vHI0dUj9kSA=="}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:41.599645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-12d8608c-8c1a-4f77-a8e9-983ad6858337 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Getting quotas for project e57720cd453848a89315ad87ace38161. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:06:41.603400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-12d8608c-8c1a-4f77-a8e9-983ad6858337 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Getting quotas for user f7b0dfb3d6514817aba4ab34fd972ba1 and project e57720cd453848a89315ad87ace38161. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:06:41.626267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-12d8608c-8c1a-4f77-a8e9-983ad6858337 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044184 May 24 13:06:41.626879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 327/643] 10.222.0.45 () {62 vars in 1199 bytes} [Tue May 24 13:06:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 24 13:06:42.937797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1612533322", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd77132b-867d-43d4-a692-2741204d16c7"}], "security_groups": [{"name": "tempest-securitygroup--1888790344"}], "key_name": "tempest-keypair-626728203", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:43.038812 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] validate_networks() for [('dd77132b-867d-43d4-a692-2741204d16c7', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:06:43.448201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:06:43.448622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:06:43.449094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:06:43.449500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:06:43.449909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:06:43.458632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:43.459075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:43.459855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:43.460281 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:43.479049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Getting quotas for project e57720cd453848a89315ad87ace38161. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:06:43.484133 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Getting quotas for user f7b0dfb3d6514817aba4ab34fd972ba1 and project e57720cd453848a89315ad87ace38161. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:06:43.495741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:06:43.498065 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:06:43.544918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7ac6f949-a828-4132-8a50-50f894265653 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.611482 May 24 13:06:43.545752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 317/644] 10.222.0.45 () {62 vars in 1187 bytes} [Tue May 24 13:06:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 13:06:43.555408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f734e5f8-9888-4e8f-8bbb-21847b3ef8f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:43.556021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f734e5f8-9888-4e8f-8bbb-21847b3ef8f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:43.613478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f734e5f8-9888-4e8f-8bbb-21847b3ef8f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:43.621764 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f734e5f8-9888-4e8f-8bbb-21847b3ef8f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:43.623299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f734e5f8-9888-4e8f-8bbb-21847b3ef8f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:43.624426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f734e5f8-9888-4e8f-8bbb-21847b3ef8f6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1281 microversion: 2.20 time: 0.072856 May 24 13:06:43.624966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 328/645] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:43 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:44.642743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:44.643961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:44.651583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:44.651886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:44.652657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:44.653093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:44.712870 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:44.720680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:44.722232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:44.723356 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-976678d3-0861-4ce0-8536-62fc9ca03e15 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1339 microversion: 2.20 time: 0.085911 May 24 13:06:44.723910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 318/646] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:44 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:45.742304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:45.743670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:45.750411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:45.750988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:45.751925 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:45.752603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:45.943240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-0f0d1267-678d-4289-8a48-884d00ea9e30 req-aa8d8ec4-dcaf-4950-8aa8-0b48a85aecec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29462bbf-3714-42f0-893e-fb7de5ca0d2b", "tag": "18ede545-422b-43fc-a7eb-acadacd87ad7"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:45.958754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-0f0d1267-678d-4289-8a48-884d00ea9e30 req-aa8d8ec4-dcaf-4950-8aa8-0b48a85aecec service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:45.959746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-0f0d1267-678d-4289-8a48-884d00ea9e30 req-aa8d8ec4-dcaf-4950-8aa8-0b48a85aecec service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:45.975345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-0f0d1267-678d-4289-8a48-884d00ea9e30 req-aa8d8ec4-dcaf-4950-8aa8-0b48a85aecec service nova] Creating event network-changed:18ede545-422b-43fc-a7eb-acadacd87ad7 for instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b on hv-cinder-84301 May 24 13:06:45.981148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-0f0d1267-678d-4289-8a48-884d00ea9e30 req-aa8d8ec4-dcaf-4950-8aa8-0b48a85aecec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043236 May 24 13:06:45.982449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 319/647] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:06:46.141007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:46.149239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:46.150967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:46.151983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bd289a0c-ffc5-4d99-9494-1c21d8ccbf7c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1407 microversion: 2.20 time: 0.414261 May 24 13:06:46.162542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 329/648] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:45 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:47.171132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:47.171826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:47.177972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:47.178459 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:47.179217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:47.179688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:47.313912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:47.322428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:47.323937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:47.325030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2cc1df4d-281a-490a-b314-1bccd981e1d8 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1407 microversion: 2.20 time: 0.158699 May 24 13:06:47.325576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 320/649] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:47 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:48.342707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:48.343357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:48.349872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:48.350336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:48.351090 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:48.351522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:48.480299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:48.488167 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:48.490373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:48.491477 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2e8da368-1370-4ac5-a7d0-434be0b07bdb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1407 microversion: 2.20 time: 0.152647 May 24 13:06:48.492028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 330/650] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:48 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:49.509144 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:49.509755 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:49.516354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:49.516804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:49.518050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:49.518523 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:49.645130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:49.652991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:49.654548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:49.655699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0dc1f77d-4529-4cd0-8d6c-9f4dde134b11 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1407 microversion: 2.20 time: 0.150379 May 24 13:06:49.656203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 321/651] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:49 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:50.675242 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:50.676560 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:50.684819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-0b0eb029-fba3-4f63-b07b-24979c4feef4 req-b5325fc6-66a9-46b9-80b9-ab0b3c3bb903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29462bbf-3714-42f0-893e-fb7de5ca0d2b", "name": "network-vif-plugged", "status": "completed", "tag": "18ede545-422b-43fc-a7eb-acadacd87ad7"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:50.689522 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:50.689975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:50.690766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:50.691197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:50.703959 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-0b0eb029-fba3-4f63-b07b-24979c4feef4 req-b5325fc6-66a9-46b9-80b9-ab0b3c3bb903 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:50.704402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-0b0eb029-fba3-4f63-b07b-24979c4feef4 req-b5325fc6-66a9-46b9-80b9-ab0b3c3bb903 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:50.715471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-0b0eb029-fba3-4f63-b07b-24979c4feef4 req-b5325fc6-66a9-46b9-80b9-ab0b3c3bb903 service nova] Creating event network-vif-plugged:18ede545-422b-43fc-a7eb-acadacd87ad7 for instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b on hv-cinder-84301 May 24 13:06:50.720665 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-0b0eb029-fba3-4f63-b07b-24979c4feef4 req-b5325fc6-66a9-46b9-80b9-ab0b3c3bb903 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096802 May 24 13:06:50.721904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 331/652] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:06:50.843444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:50.852109 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:50.853604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:50.854727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-38a3f26f-40dc-4f5c-a7b2-ba42a7145e93 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1407 microversion: 2.20 time: 0.185625 May 24 13:06:50.855273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 322/653] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:50 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:51.873943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:51.874661 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:51.881501 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:51.881942 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:51.882721 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:51.883154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:52.008658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:52.016526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:52.018433 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:52.019715 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0592a0fd-4533-4f1c-af0e-baedd721148f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1407 microversion: 2.20 time: 0.150076 May 24 13:06:52.020263 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 332/654] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:51 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:52.955748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-54ca6eea-db51-49ed-9991-915ca3c8e90d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:52.956287 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-54ca6eea-db51-49ed-9991-915ca3c8e90d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:52.962742 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54ca6eea-db51-49ed-9991-915ca3c8e90d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:52.963192 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54ca6eea-db51-49ed-9991-915ca3c8e90d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:52.963955 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54ca6eea-db51-49ed-9991-915ca3c8e90d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:52.964442 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54ca6eea-db51-49ed-9991-915ca3c8e90d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:52.989715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-54ca6eea-db51-49ed-9991-915ca3c8e90d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:06:53.037437 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:53.038056 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:53.044041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:53.044494 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:53.045291 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:53.045752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:53.065236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-54ca6eea-db51-49ed-9991-915ca3c8e90d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 204 len: 0 microversion: 2.1 time: 0.112933 May 24 13:06:53.066605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 323/655] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:06:52 2022] DELETE /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:06:53.075486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-267d5da6-b910-4254-89cb-829458fdddb6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:53.076211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-267d5da6-b910-4254-89cb-829458fdddb6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:53.082447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-267d5da6-b910-4254-89cb-829458fdddb6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:53.082907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-267d5da6-b910-4254-89cb-829458fdddb6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:53.083680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-267d5da6-b910-4254-89cb-829458fdddb6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:53.084139 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-267d5da6-b910-4254-89cb-829458fdddb6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:53.175595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:53.183519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:53.185035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:53.186188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-80a70b2e-e0c2-426e-9ab0-3475c12a2fad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1598 microversion: 2.20 time: 0.153115 May 24 13:06:53.186780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 333/656] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:06:53 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:06:53.203524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-14e78d20-3baf-4389-b244-a0cac644c99b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:53.204032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-14e78d20-3baf-4389-b244-a0cac644c99b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:53.210194 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-14e78d20-3baf-4389-b244-a0cac644c99b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:53.210667 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-14e78d20-3baf-4389-b244-a0cac644c99b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:53.211428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-14e78d20-3baf-4389-b244-a0cac644c99b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:53.211855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-14e78d20-3baf-4389-b244-a0cac644c99b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:53.217653 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-267d5da6-b910-4254-89cb-829458fdddb6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:53.225747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-267d5da6-b910-4254-89cb-829458fdddb6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1578 microversion: 2.1 time: 0.154337 May 24 13:06:53.226346 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 324/657] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:53 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:06:53.291547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-14e78d20-3baf-4389-b244-a0cac644c99b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091881 May 24 13:06:53.292143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 334/658] 10.222.0.45 () {60 vars in 1315 bytes} [Tue May 24 13:06:53 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:06:54.190554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-a37b3582-ce08-4046-b5ab-3fcda9da5b77 req-1d21f4da-fd7b-4978-97d2-e3723e1af721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29462bbf-3714-42f0-893e-fb7de5ca0d2b", "tag": "18ede545-422b-43fc-a7eb-acadacd87ad7"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:54.194034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:54.194711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:54.202245 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a37b3582-ce08-4046-b5ab-3fcda9da5b77 req-1d21f4da-fd7b-4978-97d2-e3723e1af721 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:54.202735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a37b3582-ce08-4046-b5ab-3fcda9da5b77 req-1d21f4da-fd7b-4978-97d2-e3723e1af721 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:54.216766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-a37b3582-ce08-4046-b5ab-3fcda9da5b77 req-1d21f4da-fd7b-4978-97d2-e3723e1af721 service nova] Creating event network-changed:18ede545-422b-43fc-a7eb-acadacd87ad7 for instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b on hv-cinder-84301 May 24 13:06:54.223838 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-a37b3582-ce08-4046-b5ab-3fcda9da5b77 req-1d21f4da-fd7b-4978-97d2-e3723e1af721 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036769 May 24 13:06:54.224752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 325/659] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:06:54.240092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=6 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:54.245512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6be17f6f-82b8-45f1-82bb-7e4aab66c8fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:54.246374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6be17f6f-82b8-45f1-82bb-7e4aab66c8fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:54.254021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6be17f6f-82b8-45f1-82bb-7e4aab66c8fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:54.254021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6be17f6f-82b8-45f1-82bb-7e4aab66c8fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:54.255432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6be17f6f-82b8-45f1-82bb-7e4aab66c8fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:54.255432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6be17f6f-82b8-45f1-82bb-7e4aab66c8fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:54.414639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6be17f6f-82b8-45f1-82bb-7e4aab66c8fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:54.423573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6be17f6f-82b8-45f1-82bb-7e4aab66c8fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1578 microversion: 2.1 time: 0.184304 May 24 13:06:54.424736 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 335/660] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:54 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:55.442788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-66beaf34-d09d-4b6b-8a96-a9154604653f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:55.443707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-66beaf34-d09d-4b6b-8a96-a9154604653f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:55.451169 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66beaf34-d09d-4b6b-8a96-a9154604653f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:55.451904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66beaf34-d09d-4b6b-8a96-a9154604653f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:55.452872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66beaf34-d09d-4b6b-8a96-a9154604653f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:55.453319 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66beaf34-d09d-4b6b-8a96-a9154604653f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:55.647922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-66beaf34-d09d-4b6b-8a96-a9154604653f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:55.655543 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-66beaf34-d09d-4b6b-8a96-a9154604653f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1578 microversion: 2.1 time: 0.217652 May 24 13:06:55.656066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 326/661] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:55 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:56.003270 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-1c39cf57-67fc-4ce8-96b9-6135273c7675 req-9e2993b6-6c71-421d-a6a1-59685cee3d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0868aa59-60f0-4ee6-8f6a-e58671fc79ad", "name": "network-vif-deleted", "tag": "c6aa638f-1928-47c9-9e7a-f03f61930e51"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:56.012012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-1c39cf57-67fc-4ce8-96b9-6135273c7675 req-9e2993b6-6c71-421d-a6a1-59685cee3d2a service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:56.012475 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-1c39cf57-67fc-4ce8-96b9-6135273c7675 req-9e2993b6-6c71-421d-a6a1-59685cee3d2a service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:56.026586 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-1c39cf57-67fc-4ce8-96b9-6135273c7675 req-9e2993b6-6c71-421d-a6a1-59685cee3d2a service nova] Creating event network-vif-deleted:c6aa638f-1928-47c9-9e7a-f03f61930e51 for instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad on hv-cinder-84301 May 24 13:06:56.032112 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-1c39cf57-67fc-4ce8-96b9-6135273c7675 req-9e2993b6-6c71-421d-a6a1-59685cee3d2a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033223 May 24 13:06:56.032881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 336/662] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:06:56.673669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:56.674963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:56.681531 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:56.682249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:56.683055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:56.683484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:56.727140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:56.727585 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:56.728041 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lazy-loading 'fault' on Instance uuid 0868aa59-60f0-4ee6-8f6a-e58671fc79ad {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:06:56.734995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:56.779963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:56.787685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-300d04ea-4d64-49ab-81b8-513e7d1db56d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 200 len: 1184 microversion: 2.1 time: 0.118333 May 24 13:06:56.790207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 327/663] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:56 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 1184 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:57.809374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:57.810094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:57.816364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:57.816804 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:57.817551 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:57.817980 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:57.831316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] HTTP exception thrown: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Request method failure captured: May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad HTTP/1.1 May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNeReOM_br9UiPR5uoCJody7sTzygLqdP-JwtVLzv2boMJgONbvTLDZqoV35BfGVyU-T1eRQTzVLUR0I1Tk1GPiTHgFbDUI0p1fuItXpuUAlWXzmjZyV35AwOk6bmoMy9igZIIF6iZEcXg_tm6dmmeLqEMgZKcHLKifoxhK05-hOW-o May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: b20159be9d404dd2812ffeffe055ec67 May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-TestVolumeBootPattern-1193829736 May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:06:57.832923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-TestVolumeBootPattern-1193829736 May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: b20159be9d404dd2812ffeffe055ec67 May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-TestVolumeBootPattern-1193829736 May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-TestVolumeBootPattern-1193829736-project May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: d87d9358c42a43fea94927869c44dc82 May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-TestVolumeBootPattern-1193829736-project May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:06:57.834583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '0868aa59-60f0-4ee6-8f6a-e58671fc79ad'} May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:06:57.835549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:06:57.837071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:06:57.838487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Returning 404 to user: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:06:57.838487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-05d51765-c9df-4ad8-bcae-5328a7d3a191 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 404 len: 111 microversion: 2.1 time: 0.029110 May 24 13:06:57.838487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 337/664] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:57 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:06:57.927322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1391314732", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1349995211", "security_groups": [{"name": "tempest-secgroup-smoke-1538200982"}], "block_device_mapping_v2": [{"uuid": "35f15854-5770-45a6-881f-968f36db73eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac3b194e-d24e-420f-9232-298d2ecfb486"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:06:58.036785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] validate_networks() for [('ac3b194e-d24e-420f-9232-298d2ecfb486', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:06:58.404072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:06:58.404495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:06:58.404965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:06:58.405372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:06:58.405783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:06:58.414674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:58.415150 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:58.415966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:58.416396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:58.432465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Getting quotas for project b20159be9d404dd2812ffeffe055ec67. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:06:58.436321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Getting quotas for user d87d9358c42a43fea94927869c44dc82 and project b20159be9d404dd2812ffeffe055ec67. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:06:58.506752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:06:58.508856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35f15854-5770-45a6-881f-968f36db73eb',volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:06:58.638181 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-83f6d94e-0b97-43f7-86b9-46d71cbf1daf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714648 May 24 13:06:58.638884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 328/665] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:06:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:06:58.648708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3a1420e7-f0e4-415d-bcfb-5a63479c7a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:58.649440 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3a1420e7-f0e4-415d-bcfb-5a63479c7a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:58.703176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3a1420e7-f0e4-415d-bcfb-5a63479c7a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:58.709834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3a1420e7-f0e4-415d-bcfb-5a63479c7a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1095 microversion: 2.1 time: 0.064839 May 24 13:06:58.710413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 338/666] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:58 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:06:59.727332 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5ee7c4fb-bcb0-404b-b71b-fde1252f6e73 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:06:59.727954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5ee7c4fb-bcb0-404b-b71b-fde1252f6e73 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:06:59.734557 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee7c4fb-bcb0-404b-b71b-fde1252f6e73 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:59.735012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee7c4fb-bcb0-404b-b71b-fde1252f6e73 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:59.735784 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee7c4fb-bcb0-404b-b71b-fde1252f6e73 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:06:59.736970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee7c4fb-bcb0-404b-b71b-fde1252f6e73 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:06:59.811258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ee7c4fb-bcb0-404b-b71b-fde1252f6e73 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:06:59.818731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5ee7c4fb-bcb0-404b-b71b-fde1252f6e73 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1211 microversion: 2.1 time: 0.095276 May 24 13:06:59.819301 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 329/667] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:06:59 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:00.835452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b492c197-372f-4387-b8f9-69628cc91974 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:00.836076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b492c197-372f-4387-b8f9-69628cc91974 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:00.842659 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b492c197-372f-4387-b8f9-69628cc91974 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:00.843162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b492c197-372f-4387-b8f9-69628cc91974 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:00.844705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b492c197-372f-4387-b8f9-69628cc91974 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:00.845316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b492c197-372f-4387-b8f9-69628cc91974 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:00.885592 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-38faf429-f414-45fe-a6bb-599c124f85bb req-824285d9-7ebb-4108-85f1-a7fa1f5b55b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15306de-1c66-401f-ae12-53f104459b1c", "tag": "524d6600-0659-4974-99c6-9ad37f7062ae"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:00.899413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-38faf429-f414-45fe-a6bb-599c124f85bb req-824285d9-7ebb-4108-85f1-a7fa1f5b55b0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:00.900745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-38faf429-f414-45fe-a6bb-599c124f85bb req-824285d9-7ebb-4108-85f1-a7fa1f5b55b0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:00.929905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-38faf429-f414-45fe-a6bb-599c124f85bb req-824285d9-7ebb-4108-85f1-a7fa1f5b55b0 service nova] Creating event network-changed:524d6600-0659-4974-99c6-9ad37f7062ae for instance a15306de-1c66-401f-ae12-53f104459b1c on hv-cinder-84301 May 24 13:07:00.935872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-38faf429-f414-45fe-a6bb-599c124f85bb req-824285d9-7ebb-4108-85f1-a7fa1f5b55b0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055105 May 24 13:07:00.937199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 330/668] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:01.017193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b492c197-372f-4387-b8f9-69628cc91974 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:01.025225 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b492c197-372f-4387-b8f9-69628cc91974 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.193606 May 24 13:07:01.025796 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 339/669] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:00 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:02.042406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b8555571-a76d-45fa-879d-0548f0324abd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:02.043027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b8555571-a76d-45fa-879d-0548f0324abd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:02.049699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8555571-a76d-45fa-879d-0548f0324abd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:02.050152 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8555571-a76d-45fa-879d-0548f0324abd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:02.050943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8555571-a76d-45fa-879d-0548f0324abd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:02.051379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8555571-a76d-45fa-879d-0548f0324abd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:02.220099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b8555571-a76d-45fa-879d-0548f0324abd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:02.227634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b8555571-a76d-45fa-879d-0548f0324abd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.189458 May 24 13:07:02.228203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 331/670] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:02 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:03.244060 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f68c6a9e-a058-402b-990b-269bd2e99563 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:03.244668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f68c6a9e-a058-402b-990b-269bd2e99563 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:03.250728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f68c6a9e-a058-402b-990b-269bd2e99563 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:03.251174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f68c6a9e-a058-402b-990b-269bd2e99563 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:03.251924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f68c6a9e-a058-402b-990b-269bd2e99563 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:03.252352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f68c6a9e-a058-402b-990b-269bd2e99563 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:03.378675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f68c6a9e-a058-402b-990b-269bd2e99563 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:03.386566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f68c6a9e-a058-402b-990b-269bd2e99563 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.146230 May 24 13:07:03.387375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 340/671] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:03 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:04.403742 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e9c4aade-6244-436e-9fe5-cf7a4ce77044 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:04.404485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e9c4aade-6244-436e-9fe5-cf7a4ce77044 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:04.411065 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9c4aade-6244-436e-9fe5-cf7a4ce77044 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:04.411519 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9c4aade-6244-436e-9fe5-cf7a4ce77044 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:04.412282 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9c4aade-6244-436e-9fe5-cf7a4ce77044 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:04.412723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9c4aade-6244-436e-9fe5-cf7a4ce77044 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:04.540288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e9c4aade-6244-436e-9fe5-cf7a4ce77044 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:04.547719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e9c4aade-6244-436e-9fe5-cf7a4ce77044 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.148060 May 24 13:07:04.548284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 332/672] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:04 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:05.565033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2e6cff78-4644-45b8-9072-6ad4a3ffcae1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:05.565641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2e6cff78-4644-45b8-9072-6ad4a3ffcae1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:05.571660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e6cff78-4644-45b8-9072-6ad4a3ffcae1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:05.572100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e6cff78-4644-45b8-9072-6ad4a3ffcae1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:05.572887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e6cff78-4644-45b8-9072-6ad4a3ffcae1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:05.573319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e6cff78-4644-45b8-9072-6ad4a3ffcae1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:05.698267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2e6cff78-4644-45b8-9072-6ad4a3ffcae1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:05.700535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:05.707407 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2e6cff78-4644-45b8-9072-6ad4a3ffcae1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.146868 May 24 13:07:05.708076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 341/673] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:05 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:06.555579 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-381ea93f-baa0-494f-8e18-5986ed794814 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:06.556068 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-381ea93f-baa0-494f-8e18-5986ed794814 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:06.558466 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:06.563680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-381ea93f-baa0-494f-8e18-5986ed794814 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:06.564174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-381ea93f-baa0-494f-8e18-5986ed794814 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:06.564930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-381ea93f-baa0-494f-8e18-5986ed794814 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:06.565361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-381ea93f-baa0-494f-8e18-5986ed794814 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:06.687623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-381ea93f-baa0-494f-8e18-5986ed794814 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lazy-loading 'services' on Instance uuid 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:07:06.724657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f1111405-45a9-4674-8936-7c1c8c3877e3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:06.725275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f1111405-45a9-4674-8936-7c1c8c3877e3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:06.727507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:06.732753 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f1111405-45a9-4674-8936-7c1c8c3877e3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:06.733200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f1111405-45a9-4674-8936-7c1c8c3877e3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:06.733958 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f1111405-45a9-4674-8936-7c1c8c3877e3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:06.734483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f1111405-45a9-4674-8936-7c1c8c3877e3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:06.799394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-381ea93f-baa0-494f-8e18-5986ed794814 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "DELETE /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments/7bfe5ed0-b50c-4968-a926-e19bf39d743c" status: 202 len: 0 microversion: 2.1 time: 0.247472 May 24 13:07:06.799990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 333/674] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 13:07:06 2022] DELETE /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments/7bfe5ed0-b50c-4968-a926-e19bf39d743c => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:07:06.810275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-686d2996-29b2-4e2e-bae5-57812adfc612 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:06.811184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-686d2996-29b2-4e2e-bae5-57812adfc612 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:06.818776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-686d2996-29b2-4e2e-bae5-57812adfc612 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:06.818776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-686d2996-29b2-4e2e-bae5-57812adfc612 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:06.819550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-686d2996-29b2-4e2e-bae5-57812adfc612 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:06.819984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-686d2996-29b2-4e2e-bae5-57812adfc612 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:06.852464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-686d2996-29b2-4e2e-bae5-57812adfc612 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047108 May 24 13:07:06.853174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 334/675] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:07:06 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:07:06.876048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f1111405-45a9-4674-8936-7c1c8c3877e3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:06.883527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f1111405-45a9-4674-8936-7c1c8c3877e3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.163153 May 24 13:07:06.884095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 342/676] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:06 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:07:07.866502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-77e39947-42bb-4568-9163-1f527b86b98a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:07.867974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-77e39947-42bb-4568-9163-1f527b86b98a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:07.875802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77e39947-42bb-4568-9163-1f527b86b98a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:07.876893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77e39947-42bb-4568-9163-1f527b86b98a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:07.878087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77e39947-42bb-4568-9163-1f527b86b98a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:07.878908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77e39947-42bb-4568-9163-1f527b86b98a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:07.900278 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a93007bf-a3e1-4e5f-a19f-b90f95b7ae50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:07.900899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a93007bf-a3e1-4e5f-a19f-b90f95b7ae50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:07.906992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a93007bf-a3e1-4e5f-a19f-b90f95b7ae50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:07.907953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a93007bf-a3e1-4e5f-a19f-b90f95b7ae50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:07.908725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-77e39947-42bb-4568-9163-1f527b86b98a tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048255 May 24 13:07:07.908833 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a93007bf-a3e1-4e5f-a19f-b90f95b7ae50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:07.909163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a93007bf-a3e1-4e5f-a19f-b90f95b7ae50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:07.912476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 335/677] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:07:07 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:08.035195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a93007bf-a3e1-4e5f-a19f-b90f95b7ae50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:08.042477 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a93007bf-a3e1-4e5f-a19f-b90f95b7ae50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.145983 May 24 13:07:08.043032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 343/678] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:07 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:07:08.920727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a98cc56-f256-4f69-af00-15ef528b5bd3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:08.922241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a98cc56-f256-4f69-af00-15ef528b5bd3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:08.927985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:08.929202 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:08.932638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a98cc56-f256-4f69-af00-15ef528b5bd3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:08.933297 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a98cc56-f256-4f69-af00-15ef528b5bd3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:08.934266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a98cc56-f256-4f69-af00-15ef528b5bd3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:08.934881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a98cc56-f256-4f69-af00-15ef528b5bd3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:08.970948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a98cc56-f256-4f69-af00-15ef528b5bd3 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054293 May 24 13:07:08.971792 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 336/679] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:07:08 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:09.059415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8af774e8-06d1-4957-b316-c7701aa386f9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:09.060130 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8af774e8-06d1-4957-b316-c7701aa386f9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:09.062016 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:09.068483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8af774e8-06d1-4957-b316-c7701aa386f9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:09.069010 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8af774e8-06d1-4957-b316-c7701aa386f9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:09.069860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8af774e8-06d1-4957-b316-c7701aa386f9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:09.070314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8af774e8-06d1-4957-b316-c7701aa386f9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:09.207403 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8af774e8-06d1-4957-b316-c7701aa386f9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:09.216230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8af774e8-06d1-4957-b316-c7701aa386f9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.160522 May 24 13:07:09.218025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 344/680] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:09 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:09.981717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1105437-2df5-4a20-83f4-aa2302953bf0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:09.982576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c1105437-2df5-4a20-83f4-aa2302953bf0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:09.989320 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1105437-2df5-4a20-83f4-aa2302953bf0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:09.989762 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1105437-2df5-4a20-83f4-aa2302953bf0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:09.990551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1105437-2df5-4a20-83f4-aa2302953bf0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:09.990980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1105437-2df5-4a20-83f4-aa2302953bf0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:10.018967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c1105437-2df5-4a20-83f4-aa2302953bf0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041239 May 24 13:07:10.019506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 337/681] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:07:09 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 13:07:10.090908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-153b7c10-42a7-43b6-b213-535bdee39d12 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:10.091434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-153b7c10-42a7-43b6-b213-535bdee39d12 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:10.097981 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-153b7c10-42a7-43b6-b213-535bdee39d12 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:10.098463 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-153b7c10-42a7-43b6-b213-535bdee39d12 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:10.099219 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-153b7c10-42a7-43b6-b213-535bdee39d12 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:10.099652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-153b7c10-42a7-43b6-b213-535bdee39d12 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:10.123493 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-153b7c10-42a7-43b6-b213-535bdee39d12 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Going to try to terminate instance {{(pid=117643) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:07:10.196058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-153b7c10-42a7-43b6-b213-535bdee39d12 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "DELETE /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 204 len: 0 microversion: 2.1 time: 0.108602 May 24 13:07:10.196759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 345/682] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:07:10 2022] DELETE /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:07:10.205133 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-05b24ddd-10eb-481e-888b-83051167615e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:10.205758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-05b24ddd-10eb-481e-888b-83051167615e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:10.211747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05b24ddd-10eb-481e-888b-83051167615e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:10.212199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05b24ddd-10eb-481e-888b-83051167615e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:10.212962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05b24ddd-10eb-481e-888b-83051167615e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:10.213400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05b24ddd-10eb-481e-888b-83051167615e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:10.234857 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-261881f6-569b-42ed-8e8e-e23076baeda1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:10.235513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-261881f6-569b-42ed-8e8e-e23076baeda1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:10.241696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-261881f6-569b-42ed-8e8e-e23076baeda1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:10.242147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-261881f6-569b-42ed-8e8e-e23076baeda1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:10.242969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-261881f6-569b-42ed-8e8e-e23076baeda1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:10.243412 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-261881f6-569b-42ed-8e8e-e23076baeda1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:10.346871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-05b24ddd-10eb-481e-888b-83051167615e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:10.354550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-05b24ddd-10eb-481e-888b-83051167615e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1690 microversion: 2.1 time: 0.153724 May 24 13:07:10.355157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 338/683] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:10 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:10.383361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-261881f6-569b-42ed-8e8e-e23076baeda1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:10.390874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-261881f6-569b-42ed-8e8e-e23076baeda1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.160372 May 24 13:07:10.391436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 346/684] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:10 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:07:10.840338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-a4536133-ee98-4065-96f9-0981e460859a req-e6be5e52-9eff-45ba-a230-8291610556ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15306de-1c66-401f-ae12-53f104459b1c", "name": "network-vif-plugged", "status": "completed", "tag": "524d6600-0659-4974-99c6-9ad37f7062ae"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:10.850194 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a4536133-ee98-4065-96f9-0981e460859a req-e6be5e52-9eff-45ba-a230-8291610556ae service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:10.850664 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a4536133-ee98-4065-96f9-0981e460859a req-e6be5e52-9eff-45ba-a230-8291610556ae service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:10.862525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-a4536133-ee98-4065-96f9-0981e460859a req-e6be5e52-9eff-45ba-a230-8291610556ae service nova] Creating event network-vif-plugged:524d6600-0659-4974-99c6-9ad37f7062ae for instance a15306de-1c66-401f-ae12-53f104459b1c on hv-cinder-84301 May 24 13:07:10.867474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-a4536133-ee98-4065-96f9-0981e460859a req-e6be5e52-9eff-45ba-a230-8291610556ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030921 May 24 13:07:10.868064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 339/685] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:11.371760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-715586bf-2d1c-464e-83f0-7bb9f04aa92e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:11.372380 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-715586bf-2d1c-464e-83f0-7bb9f04aa92e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:11.378470 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-715586bf-2d1c-464e-83f0-7bb9f04aa92e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:11.378924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-715586bf-2d1c-464e-83f0-7bb9f04aa92e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:11.379691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-715586bf-2d1c-464e-83f0-7bb9f04aa92e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:11.380130 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-715586bf-2d1c-464e-83f0-7bb9f04aa92e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:11.409883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8c093492-747b-453b-ad66-cb1c809d2150 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:11.410625 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8c093492-747b-453b-ad66-cb1c809d2150 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:11.418416 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c093492-747b-453b-ad66-cb1c809d2150 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:11.418872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c093492-747b-453b-ad66-cb1c809d2150 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:11.419649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c093492-747b-453b-ad66-cb1c809d2150 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:11.420089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c093492-747b-453b-ad66-cb1c809d2150 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:11.505830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-715586bf-2d1c-464e-83f0-7bb9f04aa92e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:11.513503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-715586bf-2d1c-464e-83f0-7bb9f04aa92e tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1690 microversion: 2.1 time: 0.145592 May 24 13:07:11.514070 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 347/686] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:11 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:11.552516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8c093492-747b-453b-ad66-cb1c809d2150 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:11.559861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8c093492-747b-453b-ad66-cb1c809d2150 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.155317 May 24 13:07:11.560422 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 340/687] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:11 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:12.530899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ddcc38c0-5512-4846-b965-55097d52f0d0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:12.531504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ddcc38c0-5512-4846-b965-55097d52f0d0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:12.538034 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ddcc38c0-5512-4846-b965-55097d52f0d0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:12.538511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ddcc38c0-5512-4846-b965-55097d52f0d0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:12.539261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ddcc38c0-5512-4846-b965-55097d52f0d0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:12.539692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ddcc38c0-5512-4846-b965-55097d52f0d0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:12.576456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e8b54bf0-402d-41d4-a4ba-83564627c1e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:12.577094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e8b54bf0-402d-41d4-a4ba-83564627c1e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:12.583658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8b54bf0-402d-41d4-a4ba-83564627c1e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:12.584115 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8b54bf0-402d-41d4-a4ba-83564627c1e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:12.584888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8b54bf0-402d-41d4-a4ba-83564627c1e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:12.585321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8b54bf0-402d-41d4-a4ba-83564627c1e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:12.669480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ddcc38c0-5512-4846-b965-55097d52f0d0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:12.677738 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ddcc38c0-5512-4846-b965-55097d52f0d0 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1690 microversion: 2.1 time: 0.150631 May 24 13:07:12.686706 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 348/688] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:12 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:12.719565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e8b54bf0-402d-41d4-a4ba-83564627c1e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:12.727536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e8b54bf0-402d-41d4-a4ba-83564627c1e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.154939 May 24 13:07:12.728107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 341/689] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:12 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:07:13.695382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6290a5fc-b3c3-4a6f-8537-6594068c27b6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:13.695937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6290a5fc-b3c3-4a6f-8537-6594068c27b6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:13.701952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6290a5fc-b3c3-4a6f-8537-6594068c27b6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:13.702445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6290a5fc-b3c3-4a6f-8537-6594068c27b6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:13.703225 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6290a5fc-b3c3-4a6f-8537-6594068c27b6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:13.703664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6290a5fc-b3c3-4a6f-8537-6594068c27b6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:13.745100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0fdf466c-c874-40d4-8198-a3dc69455f0a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:13.745800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0fdf466c-c874-40d4-8198-a3dc69455f0a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:13.753501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fdf466c-c874-40d4-8198-a3dc69455f0a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:13.753946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fdf466c-c874-40d4-8198-a3dc69455f0a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:13.754734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fdf466c-c874-40d4-8198-a3dc69455f0a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:13.755165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fdf466c-c874-40d4-8198-a3dc69455f0a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:13.886118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6290a5fc-b3c3-4a6f-8537-6594068c27b6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:13.894556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6290a5fc-b3c3-4a6f-8537-6594068c27b6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1690 microversion: 2.1 time: 0.203000 May 24 13:07:13.895334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 349/690] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:13 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:13.995886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0fdf466c-c874-40d4-8198-a3dc69455f0a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:14.003657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0fdf466c-c874-40d4-8198-a3dc69455f0a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.262646 May 24 13:07:14.004233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 342/691] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:13 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:07:14.911157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bc81ae39-0d78-4425-ade4-8505f06866a8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:14.911788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bc81ae39-0d78-4425-ade4-8505f06866a8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:14.947983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc81ae39-0d78-4425-ade4-8505f06866a8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:14.948452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc81ae39-0d78-4425-ade4-8505f06866a8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:14.949269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc81ae39-0d78-4425-ade4-8505f06866a8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:14.949719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc81ae39-0d78-4425-ade4-8505f06866a8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:14.996267 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-2b505130-913f-48fd-bd7e-42d07a303b9f req-d3dea234-fba8-4c6a-86e4-907c91ea66fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968b8af5-f426-4c06-bf8a-fd06bc9e71d7", "name": "network-vif-deleted", "tag": "98ea03b5-b5f4-4953-9488-c61cc24f6125"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:15.007149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2b505130-913f-48fd-bd7e-42d07a303b9f req-d3dea234-fba8-4c6a-86e4-907c91ea66fc service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:15.007927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2b505130-913f-48fd-bd7e-42d07a303b9f req-d3dea234-fba8-4c6a-86e4-907c91ea66fc service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:15.020791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-2b505130-913f-48fd-bd7e-42d07a303b9f req-d3dea234-fba8-4c6a-86e4-907c91ea66fc service nova] Creating event network-vif-deleted:98ea03b5-b5f4-4953-9488-c61cc24f6125 for instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 on hv-cinder-84301 May 24 13:07:15.025993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-2b505130-913f-48fd-bd7e-42d07a303b9f req-d3dea234-fba8-4c6a-86e4-907c91ea66fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 May 24 13:07:15.026922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 343/692] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:07:15.028274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bc81ae39-0d78-4425-ade4-8505f06866a8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:15.034307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a3b83111-81f7-41c6-8336-f2a68375f14e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:15.035406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a3b83111-81f7-41c6-8336-f2a68375f14e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:15.036777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bc81ae39-0d78-4425-ade4-8505f06866a8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 200 len: 1623 microversion: 2.1 time: 0.130043 May 24 13:07:15.037361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 350/693] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:14 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 1623 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:15.044154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a3b83111-81f7-41c6-8336-f2a68375f14e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:15.045075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a3b83111-81f7-41c6-8336-f2a68375f14e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:15.046521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a3b83111-81f7-41c6-8336-f2a68375f14e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:15.047306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a3b83111-81f7-41c6-8336-f2a68375f14e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:15.189767 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a3b83111-81f7-41c6-8336-f2a68375f14e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:15.197455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a3b83111-81f7-41c6-8336-f2a68375f14e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1267 microversion: 2.1 time: 0.169227 May 24 13:07:15.198016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 344/694] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:15 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:16.054149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:16.054768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: 968b8af5-f426-4c06-bf8a-fd06bc9e71d7] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:16.061663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:16.062127 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:16.062941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:16.063390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:16.078315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] HTTP exception thrown: Instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 could not be found. May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Request method failure captured: May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 HTTP/1.1 May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbk1m2T0FVB_cowxlzFZQfSHOpRVI9qCWVHjb_tithLQX15Ze6FudOun7uaWC1WgdzOGlkCCMv9N7uEpRLg0FHpv0Qtqjx_79FscW-065fahLrq7wPXW2IVrIkFc2ISrVCiR1ErbpQ1shxRRVCO35nu5BuuLWvvWyK8OB9kj9ByHGI May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:07:16.080136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 91a76f7af8a5467bbf567ca5b9db9ce0 May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 could not be found. May 24 13:07:16.081439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '968b8af5-f426-4c06-bf8a-fd06bc9e71d7'} May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 could not be found. May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:07:16.082203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 could not be found. May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 could not be found. May 24 13:07:16.083550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:16.084703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Returning 404 to user: Instance 968b8af5-f426-4c06-bf8a-fd06bc9e71d7 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:07:16.084703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-73382c6c-cdc9-4866-9992-b3bc84c88ffb tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7" status: 404 len: 111 microversion: 2.1 time: 0.031401 May 24 13:07:16.084703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 351/695] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:16 2022] GET /compute/v2.1/servers/968b8af5-f426-4c06-bf8a-fd06bc9e71d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:07:16.090146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cd3876d2-1733-44cd-b89f-837b9a148fd6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '.version_select at 0x7f9a66eae550>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:16.108229 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cd3876d2-1733-44cd-b89f-837b9a148fd6 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250656988" status: 202 len: 0 microversion: 2.1 time: 0.021839 May 24 13:07:16.108802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 345/696] 10.222.0.45 () {58 vars in 1220 bytes} [Tue May 24 13:07:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250656988 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:07:16.214892 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3946d6c8-152f-4084-8d62-15ec61ec5e23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:16.215513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3946d6c8-152f-4084-8d62-15ec61ec5e23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:16.222011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3946d6c8-152f-4084-8d62-15ec61ec5e23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:16.222490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3946d6c8-152f-4084-8d62-15ec61ec5e23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:16.223259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3946d6c8-152f-4084-8d62-15ec61ec5e23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:16.223694 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3946d6c8-152f-4084-8d62-15ec61ec5e23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:16.364525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3946d6c8-152f-4084-8d62-15ec61ec5e23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:16.372102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3946d6c8-152f-4084-8d62-15ec61ec5e23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1453 microversion: 2.1 time: 0.161099 May 24 13:07:16.372878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 352/697] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:16 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:16.388666 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-531e1ed1-288b-4d7e-85a2-8ad89b6cd61a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:16.389301 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-531e1ed1-288b-4d7e-85a2-8ad89b6cd61a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:16.395569 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-531e1ed1-288b-4d7e-85a2-8ad89b6cd61a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:16.396017 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-531e1ed1-288b-4d7e-85a2-8ad89b6cd61a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:16.396776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-531e1ed1-288b-4d7e-85a2-8ad89b6cd61a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:16.397215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-531e1ed1-288b-4d7e-85a2-8ad89b6cd61a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:16.820086 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-531e1ed1-288b-4d7e-85a2-8ad89b6cd61a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:16.827554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-531e1ed1-288b-4d7e-85a2-8ad89b6cd61a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1453 microversion: 2.1 time: 0.442973 May 24 13:07:16.828107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 346/698] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:16 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1453 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:18.541855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-a4d0bf37-8b32-4ab0-ba1a-aaa5ad9c5af7 req-f5a9878c-ddc1-4634-8f4c-712e6cd6cab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15306de-1c66-401f-ae12-53f104459b1c", "tag": "524d6600-0659-4974-99c6-9ad37f7062ae"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:18.549851 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-a4d0bf37-8b32-4ab0-ba1a-aaa5ad9c5af7 req-f5a9878c-ddc1-4634-8f4c-712e6cd6cab0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:18.550305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-a4d0bf37-8b32-4ab0-ba1a-aaa5ad9c5af7 req-f5a9878c-ddc1-4634-8f4c-712e6cd6cab0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:18.560974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-a4d0bf37-8b32-4ab0-ba1a-aaa5ad9c5af7 req-f5a9878c-ddc1-4634-8f4c-712e6cd6cab0 service nova] Creating event network-changed:524d6600-0659-4974-99c6-9ad37f7062ae for instance a15306de-1c66-401f-ae12-53f104459b1c on hv-cinder-84301 May 24 13:07:18.566544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-a4d0bf37-8b32-4ab0-ba1a-aaa5ad9c5af7 req-f5a9878c-ddc1-4634-8f4c-712e6cd6cab0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028249 May 24 13:07:18.567334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 353/699] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:19.346944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ddf91439-4057-4af7-88d0-5a93558d3e77 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:19.347496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ddf91439-4057-4af7-88d0-5a93558d3e77 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:19.354457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddf91439-4057-4af7-88d0-5a93558d3e77 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:19.354997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddf91439-4057-4af7-88d0-5a93558d3e77 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:19.355848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddf91439-4057-4af7-88d0-5a93558d3e77 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:19.356357 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddf91439-4057-4af7-88d0-5a93558d3e77 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:19.361746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:19.384372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ddf91439-4057-4af7-88d0-5a93558d3e77 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:07:19.467552 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ddf91439-4057-4af7-88d0-5a93558d3e77 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 204 len: 0 microversion: 2.1 time: 0.123921 May 24 13:07:19.468153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 347/700] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:07:19 2022] DELETE /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:07:19.477400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d9945ca9-80be-47ca-ae78-42b71845396b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:19.478106 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d9945ca9-80be-47ca-ae78-42b71845396b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:19.484627 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d9945ca9-80be-47ca-ae78-42b71845396b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:19.485084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d9945ca9-80be-47ca-ae78-42b71845396b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:19.486503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d9945ca9-80be-47ca-ae78-42b71845396b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:19.486944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d9945ca9-80be-47ca-ae78-42b71845396b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:19.616986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d9945ca9-80be-47ca-ae78-42b71845396b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:19.624435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d9945ca9-80be-47ca-ae78-42b71845396b tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1508 microversion: 2.1 time: 0.151223 May 24 13:07:19.624992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 354/701] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:19 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:20.641653 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5ccebe4e-b485-4eb6-a94f-49654e872bb5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:20.642386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5ccebe4e-b485-4eb6-a94f-49654e872bb5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:20.649014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ccebe4e-b485-4eb6-a94f-49654e872bb5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:20.649466 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ccebe4e-b485-4eb6-a94f-49654e872bb5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:20.650214 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ccebe4e-b485-4eb6-a94f-49654e872bb5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:20.650671 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ccebe4e-b485-4eb6-a94f-49654e872bb5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:20.778818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ccebe4e-b485-4eb6-a94f-49654e872bb5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:20.786859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5ccebe4e-b485-4eb6-a94f-49654e872bb5 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1508 microversion: 2.1 time: 0.149645 May 24 13:07:20.787418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 348/702] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:20 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:21.457823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-a89e326b-704c-4ee1-98ed-8b1d9e6904b2 req-826eb5e9-e154-4682-b9e1-545cdf5b022c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d64168-bd90-4c29-bb47-7d69d4c12f4a", "name": "network-vif-deleted", "tag": "b856b728-8b89-4bce-b61b-c056d80281f4"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:21.468381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-a89e326b-704c-4ee1-98ed-8b1d9e6904b2 req-826eb5e9-e154-4682-b9e1-545cdf5b022c service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:21.468969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-a89e326b-704c-4ee1-98ed-8b1d9e6904b2 req-826eb5e9-e154-4682-b9e1-545cdf5b022c service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:21.481590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-a89e326b-704c-4ee1-98ed-8b1d9e6904b2 req-826eb5e9-e154-4682-b9e1-545cdf5b022c service nova] Creating event network-vif-deleted:b856b728-8b89-4bce-b61b-c056d80281f4 for instance c3d64168-bd90-4c29-bb47-7d69d4c12f4a on hv-cinder-84301 May 24 13:07:21.486937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-a89e326b-704c-4ee1-98ed-8b1d9e6904b2 req-826eb5e9-e154-4682-b9e1-545cdf5b022c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033993 May 24 13:07:21.487733 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 355/703] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:21.804221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:21.804941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:21.812405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:21.812893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:21.814271 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:21.814734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:21.850272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:21.851036 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:21.851647 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lazy-loading 'fault' on Instance uuid c3d64168-bd90-4c29-bb47-7d69d4c12f4a {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:07:21.906100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:21.914116 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-62298e9c-61de-4806-bfe2-4813c5004804 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 200 len: 1312 microversion: 2.1 time: 0.113847 May 24 13:07:21.924913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 349/704] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:21 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:22.933062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:22.933762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: c3d64168-bd90-4c29-bb47-7d69d4c12f4a] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:22.940044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:22.940494 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:22.942607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:22.943059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:22.963491 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] HTTP exception thrown: Instance c3d64168-bd90-4c29-bb47-7d69d4c12f4a could not be found. May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Request method failure captured: May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a HTTP/1.1 May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbk1m2T0FVB_cowxlzFZQfSHOpRVI9qCWVHjb_tithLQX15Ze6FudOun7uaWC1WgdzOGlkCCMv9N7uEpRLg0FHpv0Qtqjx_79FscW-065fahLrq7wPXW2IVrIkFc2ISrVCiR1ErbpQ1shxRRVCO35nu5BuuLWvvWyK8OB9kj9ByHGI May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:07:22.965107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 91a76f7af8a5467bbf567ca5b9db9ce0 May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance c3d64168-bd90-4c29-bb47-7d69d4c12f4a could not be found. May 24 13:07:22.966624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': 'c3d64168-bd90-4c29-bb47-7d69d4c12f4a'} May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d64168-bd90-4c29-bb47-7d69d4c12f4a could not be found. May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:07:22.967483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d64168-bd90-4c29-bb47-7d69d4c12f4a could not be found. May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d64168-bd90-4c29-bb47-7d69d4c12f4a could not be found. May 24 13:07:22.968885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:22.970818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Returning 404 to user: Instance c3d64168-bd90-4c29-bb47-7d69d4c12f4a could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:07:22.970818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4fe37288-3f9e-4fe6-8153-899cee57f865 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a" status: 404 len: 111 microversion: 2.1 time: 0.039679 May 24 13:07:22.970818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 356/705] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:22 2022] GET /compute/v2.1/servers/c3d64168-bd90-4c29-bb47-7d69d4c12f4a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:07:22.977371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-144dd799-6e9f-424e-bcf9-7e5dbdda4cc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:22.977864 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-144dd799-6e9f-424e-bcf9-7e5dbdda4cc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:22.984335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-144dd799-6e9f-424e-bcf9-7e5dbdda4cc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:22.984781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-144dd799-6e9f-424e-bcf9-7e5dbdda4cc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:22.986179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-144dd799-6e9f-424e-bcf9-7e5dbdda4cc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:22.986637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-144dd799-6e9f-424e-bcf9-7e5dbdda4cc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:23.010783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-144dd799-6e9f-424e-bcf9-7e5dbdda4cc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:07:23.082098 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-144dd799-6e9f-424e-bcf9-7e5dbdda4cc4 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 204 len: 0 microversion: 2.1 time: 0.108169 May 24 13:07:23.082786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 350/706] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:07:22 2022] DELETE /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:07:23.090644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-aa12fb27-5bc0-42e2-9814-e9ff4dd49eb8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:23.091263 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-aa12fb27-5bc0-42e2-9814-e9ff4dd49eb8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:23.097708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa12fb27-5bc0-42e2-9814-e9ff4dd49eb8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:23.098162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa12fb27-5bc0-42e2-9814-e9ff4dd49eb8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:23.098949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa12fb27-5bc0-42e2-9814-e9ff4dd49eb8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:23.099385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aa12fb27-5bc0-42e2-9814-e9ff4dd49eb8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:23.224952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-aa12fb27-5bc0-42e2-9814-e9ff4dd49eb8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:23.232552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-aa12fb27-5bc0-42e2-9814-e9ff4dd49eb8 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.145711 May 24 13:07:23.233395 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 357/707] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:23 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:07:24.251677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-93c1a924-6fa3-40f4-9b36-4657f11a1980 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:24.252410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-93c1a924-6fa3-40f4-9b36-4657f11a1980 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:24.258866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93c1a924-6fa3-40f4-9b36-4657f11a1980 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:24.259326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93c1a924-6fa3-40f4-9b36-4657f11a1980 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:24.260122 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93c1a924-6fa3-40f4-9b36-4657f11a1980 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:24.260561 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93c1a924-6fa3-40f4-9b36-4657f11a1980 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:24.386224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-93c1a924-6fa3-40f4-9b36-4657f11a1980 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:24.393724 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-93c1a924-6fa3-40f4-9b36-4657f11a1980 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.147019 May 24 13:07:24.394305 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 351/708] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:24 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:24.545170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-308c30c1-b4f9-4d9e-96f7-c013b5e9d9ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:24.546096 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-308c30c1-b4f9-4d9e-96f7-c013b5e9d9ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:24.552728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-308c30c1-b4f9-4d9e-96f7-c013b5e9d9ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:24.553172 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-308c30c1-b4f9-4d9e-96f7-c013b5e9d9ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:24.553923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-308c30c1-b4f9-4d9e-96f7-c013b5e9d9ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:24.554385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-308c30c1-b4f9-4d9e-96f7-c013b5e9d9ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:24.582091 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-308c30c1-b4f9-4d9e-96f7-c013b5e9d9ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040766 May 24 13:07:24.582656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 358/709] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:07:24 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 13:07:24.638912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0ac86697-e353-4911-a9f4-25592069fc20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:24.639411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0ac86697-e353-4911-a9f4-25592069fc20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:24.645300 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ac86697-e353-4911-a9f4-25592069fc20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:24.645747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ac86697-e353-4911-a9f4-25592069fc20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:24.646549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ac86697-e353-4911-a9f4-25592069fc20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:24.646985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ac86697-e353-4911-a9f4-25592069fc20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:24.671834 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0ac86697-e353-4911-a9f4-25592069fc20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:07:24.743991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0ac86697-e353-4911-a9f4-25592069fc20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 204 len: 0 microversion: 2.1 time: 0.108574 May 24 13:07:24.744553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 352/710] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:07:24 2022] DELETE /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:07:24.752832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-927ae87e-5dab-4b95-9619-8daa4ba67ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:24.753378 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-927ae87e-5dab-4b95-9619-8daa4ba67ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:24.759273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-927ae87e-5dab-4b95-9619-8daa4ba67ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:24.759721 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-927ae87e-5dab-4b95-9619-8daa4ba67ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:24.760474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-927ae87e-5dab-4b95-9619-8daa4ba67ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:24.760908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-927ae87e-5dab-4b95-9619-8daa4ba67ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:24.775640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:24.890562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-927ae87e-5dab-4b95-9619-8daa4ba67ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:24.898481 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-927ae87e-5dab-4b95-9619-8daa4ba67ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1674 microversion: 2.1 time: 0.149665 May 24 13:07:24.899037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 359/711] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:24 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:25.410709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c69a1ffc-ec33-417c-b54e-a0a2552ac6d7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:25.411600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c69a1ffc-ec33-417c-b54e-a0a2552ac6d7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:25.418112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c69a1ffc-ec33-417c-b54e-a0a2552ac6d7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:25.418605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c69a1ffc-ec33-417c-b54e-a0a2552ac6d7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:25.419375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c69a1ffc-ec33-417c-b54e-a0a2552ac6d7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:25.419816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c69a1ffc-ec33-417c-b54e-a0a2552ac6d7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:25.550761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c69a1ffc-ec33-417c-b54e-a0a2552ac6d7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:25.558112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c69a1ffc-ec33-417c-b54e-a0a2552ac6d7 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1521 microversion: 2.1 time: 0.151832 May 24 13:07:25.558703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 353/712] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:25 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:25.916166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c90189a7-e3b7-48d2-9b26-de305dc6802a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:25.916778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c90189a7-e3b7-48d2-9b26-de305dc6802a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:25.923365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c90189a7-e3b7-48d2-9b26-de305dc6802a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:25.923813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c90189a7-e3b7-48d2-9b26-de305dc6802a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:25.924573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c90189a7-e3b7-48d2-9b26-de305dc6802a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:25.925009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c90189a7-e3b7-48d2-9b26-de305dc6802a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:26.144917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c90189a7-e3b7-48d2-9b26-de305dc6802a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:26.152351 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c90189a7-e3b7-48d2-9b26-de305dc6802a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1674 microversion: 2.1 time: 0.239997 May 24 13:07:26.153123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 360/713] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:25 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:26.491056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-930d36c3-ea35-46cb-a0b4-84e7b35c8ffa req-ab54bfa7-bc95-4c99-9374-25115ca6bf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfc07c6-54c6-40b9-83bb-0343afadb737", "name": "network-vif-deleted", "tag": "e281dabe-d4a2-4efa-97d5-a1ac6bcb3589"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:26.503802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-930d36c3-ea35-46cb-a0b4-84e7b35c8ffa req-ab54bfa7-bc95-4c99-9374-25115ca6bf83 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:26.504520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-930d36c3-ea35-46cb-a0b4-84e7b35c8ffa req-ab54bfa7-bc95-4c99-9374-25115ca6bf83 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:26.576212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:26.576916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:26.587251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:26.587703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:26.592161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:26.592985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:26.661853 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:26.662323 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:26.662788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lazy-loading 'fault' on Instance uuid ecfc07c6-54c6-40b9-83bb-0343afadb737 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:07:26.700601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-930d36c3-ea35-46cb-a0b4-84e7b35c8ffa req-ab54bfa7-bc95-4c99-9374-25115ca6bf83 service nova] Creating event network-vif-deleted:e281dabe-d4a2-4efa-97d5-a1ac6bcb3589 for instance ecfc07c6-54c6-40b9-83bb-0343afadb737 on hv-cinder-84301 May 24 13:07:26.706411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-930d36c3-ea35-46cb-a0b4-84e7b35c8ffa req-ab54bfa7-bc95-4c99-9374-25115ca6bf83 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221413 May 24 13:07:26.707173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 354/714] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:26.709843 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76f7af8a5467bbf567ca5b9db9ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92196ee4d214c999d303c7f8e28a9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:26.717824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cf78ce21-e2d9-4374-aa8e-6de06072d129 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 200 len: 1311 microversion: 2.1 time: 0.145586 May 24 13:07:26.718410 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 361/715] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:26 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 1311 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:27.170575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6d8f0114-8e2e-4a3c-9265-dfc1a1041f1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:27.171221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6d8f0114-8e2e-4a3c-9265-dfc1a1041f1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:27.177350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8f0114-8e2e-4a3c-9265-dfc1a1041f1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:27.177797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8f0114-8e2e-4a3c-9265-dfc1a1041f1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:27.178583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8f0114-8e2e-4a3c-9265-dfc1a1041f1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:27.179017 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8f0114-8e2e-4a3c-9265-dfc1a1041f1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:27.503256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6d8f0114-8e2e-4a3c-9265-dfc1a1041f1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:27.511923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6d8f0114-8e2e-4a3c-9265-dfc1a1041f1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 200 len: 1606 microversion: 2.1 time: 0.345469 May 24 13:07:27.512883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 355/716] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:27 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 1606 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:27.526675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-cd701704-4f47-47a9-8278-dd32dcd42fd8 req-392c3086-8af3-4d8f-a7ce-e8dc569e8494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6db3c9-4cac-4157-ba43-3c425854302d", "name": "network-vif-deleted", "tag": "59643b71-d317-4922-9d19-0298524e0346"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:27.542403 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-cd701704-4f47-47a9-8278-dd32dcd42fd8 req-392c3086-8af3-4d8f-a7ce-e8dc569e8494 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:27.543220 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-cd701704-4f47-47a9-8278-dd32dcd42fd8 req-392c3086-8af3-4d8f-a7ce-e8dc569e8494 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:27.555635 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-cd701704-4f47-47a9-8278-dd32dcd42fd8 req-392c3086-8af3-4d8f-a7ce-e8dc569e8494 service nova] Creating event network-vif-deleted:59643b71-d317-4922-9d19-0298524e0346 for instance dc6db3c9-4cac-4157-ba43-3c425854302d on hv-cinder-84301 May 24 13:07:27.560571 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-cd701704-4f47-47a9-8278-dd32dcd42fd8 req-392c3086-8af3-4d8f-a7ce-e8dc569e8494 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047407 May 24 13:07:27.561165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 362/717] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:27.735273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:27.736002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] [instance: ecfc07c6-54c6-40b9-83bb-0343afadb737] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:27.742830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:27.743384 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:27.744218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:27.744681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:27.758655 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] HTTP exception thrown: Instance ecfc07c6-54c6-40b9-83bb-0343afadb737 could not be found. May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Request method failure captured: May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 HTTP/1.1 May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNbk1m2T0FVB_cowxlzFZQfSHOpRVI9qCWVHjb_tithLQX15Ze6FudOun7uaWC1WgdzOGlkCCMv9N7uEpRLg0FHpv0Qtqjx_79FscW-065fahLrq7wPXW2IVrIkFc2ISrVCiR1ErbpQ1shxRRVCO35nu5BuuLWvvWyK8OB9kj9ByHGI May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:07:27.760338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a92196ee4d214c999d303c7f8e28a9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: a92196ee4d214c999d303c7f8e28a9ce May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-913005991 May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 91a76f7af8a5467bbf567ca5b9db9ce0 May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-913005991-project May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance ecfc07c6-54c6-40b9-83bb-0343afadb737 could not be found. May 24 13:07:27.761920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'ecfc07c6-54c6-40b9-83bb-0343afadb737'} May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecfc07c6-54c6-40b9-83bb-0343afadb737 could not be found. May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:07:27.762856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecfc07c6-54c6-40b9-83bb-0343afadb737 could not be found. May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecfc07c6-54c6-40b9-83bb-0343afadb737 could not be found. May 24 13:07:27.764321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:07:27.765635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] Returning 404 to user: Instance ecfc07c6-54c6-40b9-83bb-0343afadb737 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:07:27.765635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-466dbf28-5c87-4fe9-a39c-686dd7c32410 tempest-ServerRescueNegativeTestJSON-913005991 tempest-ServerRescueNegativeTestJSON-913005991-project] 10.222.0.45 "GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737" status: 404 len: 111 microversion: 2.1 time: 0.030627 May 24 13:07:27.765635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 356/718] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:27 2022] GET /compute/v2.1/servers/ecfc07c6-54c6-40b9-83bb-0343afadb737 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 13:07:28.530139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:28.530904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:28.537720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:28.538168 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:28.538994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:28.539428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:28.552560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] HTTP exception thrown: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Request method failure captured: May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d HTTP/1.1 May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbfqW4vUG_9aIlXYzCBVkliEqdErqpH0IfBp99DgZNNPcUUq8SNc-8PheLvWrZcYDu0QF9LvDb-9YchpZjYc-Yirqch7ELpLxT2va1NN1JUSRGFzEj38M_QXwStFjiRXAyE0EEe0JcHTCFl8XofSjI9xskoaSWzpUBAa0eVh1H7iAA May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 728de65d013a489594d837589c7b978b May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:07:28.554206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/728de65d013a489594d837589c7b978b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_728de65d013a489594d837589c7b978b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeTestJSON-1500266109 May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 728de65d013a489594d837589c7b978b May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: cb3d46a7a0ae40e9b157b7199b18de27 May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:07:28.555822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': 'dc6db3c9-4cac-4157-ba43-3c425854302d'} May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:07:28.556725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:07:28.557908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:07:28.559033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Returning 404 to user: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:07:28.559033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5b80d12f-eea2-46dd-b71f-c493140681b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 404 len: 111 microversion: 2.1 time: 0.029917 May 24 13:07:28.559033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 363/719] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:28 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:07:28.565012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b059bf5d-9d92-4ca3-906d-6f5b1773947d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '.version_select at 0x7f9a66eaea60>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:28.583675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b059bf5d-9d92-4ca3-906d-6f5b1773947d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113186983" status: 202 len: 0 microversion: 2.1 time: 0.022955 May 24 13:07:28.584545 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 357/720] 10.222.0.45 () {58 vars in 1220 bytes} [Tue May 24 13:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113186983 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:07:29.263183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-506fda5c-18e6-41b1-9264-edd4ca8bc764 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'create', calling method: .version_select at 0x7f9a65e3eb80>, body: {"keypair": {"name": "tempest-keypair-471226213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdNGgtY/+g0EOalMaTP83zqrKR43p53QHJlDedyGrpENaivCY2wmuj6TNtEKkZTYQnyyv/fOMdkGwGvXak4RES3OFHifwCiJudOiO8RQ7A4x19JX403i3ttJcQcU6ZSWA=="}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:29.279532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-506fda5c-18e6-41b1-9264-edd4ca8bc764 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Getting quotas for project 728de65d013a489594d837589c7b978b. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:07:29.285871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-506fda5c-18e6-41b1-9264-edd4ca8bc764 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Getting quotas for user cb3d46a7a0ae40e9b157b7199b18de27 and project 728de65d013a489594d837589c7b978b. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:07:29.314266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-506fda5c-18e6-41b1-9264-edd4ca8bc764 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054772 May 24 13:07:29.315066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 364/721] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 13:07:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:30.635312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1703750647", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee4ef809-826a-4a41-8592-dda9f9d87ae5"}], "security_groups": [{"name": "tempest-securitygroup--1316702301"}], "key_name": "tempest-keypair-471226213", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:30.740880 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] validate_networks() for [('ee4ef809-826a-4a41-8592-dda9f9d87ae5', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:07:31.402045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:07:31.402744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:07:31.403285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:07:31.403763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:07:31.404243 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:07:31.414056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:31.414795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:31.415657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:31.416157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:31.432940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Getting quotas for project 728de65d013a489594d837589c7b978b. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:07:31.437124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Getting quotas for user cb3d46a7a0ae40e9b157b7199b18de27 and project 728de65d013a489594d837589c7b978b. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:07:31.448582 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:07:31.450984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:07:31.499769 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-37406874-7555-4222-946d-141a61970df2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.869290 May 24 13:07:31.500428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 358/722] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:07:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:07:31.510331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6c555514-d36c-45a4-a34e-ca1f5ab2acdf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:31.511516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6c555514-d36c-45a4-a34e-ca1f5ab2acdf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:31.604206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6c555514-d36c-45a4-a34e-ca1f5ab2acdf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:31.611979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6c555514-d36c-45a4-a34e-ca1f5ab2acdf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1237 microversion: 2.1 time: 0.105435 May 24 13:07:31.612976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 365/723] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:32.629420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e1136b2-d2f3-4698-bc31-50d1e2ea10d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:32.630036 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e1136b2-d2f3-4698-bc31-50d1e2ea10d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:32.636555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e1136b2-d2f3-4698-bc31-50d1e2ea10d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:32.637218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e1136b2-d2f3-4698-bc31-50d1e2ea10d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:32.638163 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e1136b2-d2f3-4698-bc31-50d1e2ea10d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:32.638783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e1136b2-d2f3-4698-bc31-50d1e2ea10d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:32.708293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e1136b2-d2f3-4698-bc31-50d1e2ea10d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:32.715778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e1136b2-d2f3-4698-bc31-50d1e2ea10d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1295 microversion: 2.1 time: 0.090703 May 24 13:07:32.716329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 359/724] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:33.735466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8aee8705-8351-479a-891c-04907a1dd3f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:33.736164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8aee8705-8351-479a-891c-04907a1dd3f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:33.743499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8aee8705-8351-479a-891c-04907a1dd3f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:33.756955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8aee8705-8351-479a-891c-04907a1dd3f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:33.759249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8aee8705-8351-479a-891c-04907a1dd3f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:33.760218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8aee8705-8351-479a-891c-04907a1dd3f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:33.964845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8aee8705-8351-479a-891c-04907a1dd3f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:33.975772 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8aee8705-8351-479a-891c-04907a1dd3f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1363 microversion: 2.1 time: 0.245361 May 24 13:07:33.986610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 366/725] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:34.017302 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-d441c433-a0c9-43b6-a543-d50143ca1ece req-30ce34de-aa02-4c28-b370-ba3204e0546b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e87855-d184-4691-9f6b-40e2b7d023d1", "tag": "db9d7b26-9bf6-4842-89a1-604c6eb29592"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:34.039152 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d441c433-a0c9-43b6-a543-d50143ca1ece req-30ce34de-aa02-4c28-b370-ba3204e0546b service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:34.039804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d441c433-a0c9-43b6-a543-d50143ca1ece req-30ce34de-aa02-4c28-b370-ba3204e0546b service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:34.069416 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-d441c433-a0c9-43b6-a543-d50143ca1ece req-30ce34de-aa02-4c28-b370-ba3204e0546b service nova] Creating event network-changed:db9d7b26-9bf6-4842-89a1-604c6eb29592 for instance 48e87855-d184-4691-9f6b-40e2b7d023d1 on hv-cinder-84301 May 24 13:07:34.090918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-d441c433-a0c9-43b6-a543-d50143ca1ece req-30ce34de-aa02-4c28-b370-ba3204e0546b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077887 May 24 13:07:34.091867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 360/726] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:34.994690 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7eb5e64b-b920-4174-8a04-3c5b6430dbdc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:34.995334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7eb5e64b-b920-4174-8a04-3c5b6430dbdc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:35.002165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7eb5e64b-b920-4174-8a04-3c5b6430dbdc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:35.002640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7eb5e64b-b920-4174-8a04-3c5b6430dbdc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:35.003401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7eb5e64b-b920-4174-8a04-3c5b6430dbdc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:35.003835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7eb5e64b-b920-4174-8a04-3c5b6430dbdc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:35.134880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7eb5e64b-b920-4174-8a04-3c5b6430dbdc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:35.142347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7eb5e64b-b920-4174-8a04-3c5b6430dbdc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1363 microversion: 2.1 time: 0.151891 May 24 13:07:35.142913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 367/727] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:07:36.160399 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-225a4088-24c5-4e07-8b16-1d766f1e7380 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:36.161197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-225a4088-24c5-4e07-8b16-1d766f1e7380 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:36.168053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-225a4088-24c5-4e07-8b16-1d766f1e7380 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:36.168580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-225a4088-24c5-4e07-8b16-1d766f1e7380 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:36.169547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-225a4088-24c5-4e07-8b16-1d766f1e7380 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:36.170054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-225a4088-24c5-4e07-8b16-1d766f1e7380 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:36.319117 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-225a4088-24c5-4e07-8b16-1d766f1e7380 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:36.327089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-225a4088-24c5-4e07-8b16-1d766f1e7380 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1363 microversion: 2.1 time: 0.171541 May 24 13:07:36.327646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 361/728] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:37.346258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2810d409-2ad5-4efa-a594-604e84efeb05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:37.347198 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2810d409-2ad5-4efa-a594-604e84efeb05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:37.350373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:37.354326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2810d409-2ad5-4efa-a594-604e84efeb05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:37.355007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2810d409-2ad5-4efa-a594-604e84efeb05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:37.355782 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2810d409-2ad5-4efa-a594-604e84efeb05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:37.356217 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2810d409-2ad5-4efa-a594-604e84efeb05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:37.505241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2810d409-2ad5-4efa-a594-604e84efeb05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:37.512921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2810d409-2ad5-4efa-a594-604e84efeb05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1363 microversion: 2.1 time: 0.171773 May 24 13:07:37.513493 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 368/729] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:38.530515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-975db462-2040-44f7-9aca-043bcb2c81cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:38.531049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-975db462-2040-44f7-9aca-043bcb2c81cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:38.534109 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:38.539796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975db462-2040-44f7-9aca-043bcb2c81cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:38.540252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975db462-2040-44f7-9aca-043bcb2c81cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:38.541025 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975db462-2040-44f7-9aca-043bcb2c81cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:38.541465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975db462-2040-44f7-9aca-043bcb2c81cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:38.546404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:38.678697 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-975db462-2040-44f7-9aca-043bcb2c81cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:38.686134 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-975db462-2040-44f7-9aca-043bcb2c81cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1363 microversion: 2.1 time: 0.159648 May 24 13:07:38.686723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 362/730] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:38.901822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-740f4c35-c431-4905-893a-bd173004ebd6 req-3a62b7a5-b5ae-4e6c-a3ad-84c6512e8863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e87855-d184-4691-9f6b-40e2b7d023d1", "name": "network-vif-plugged", "status": "completed", "tag": "db9d7b26-9bf6-4842-89a1-604c6eb29592"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:38.910889 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-740f4c35-c431-4905-893a-bd173004ebd6 req-3a62b7a5-b5ae-4e6c-a3ad-84c6512e8863 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:38.911419 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-740f4c35-c431-4905-893a-bd173004ebd6 req-3a62b7a5-b5ae-4e6c-a3ad-84c6512e8863 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:38.925008 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-740f4c35-c431-4905-893a-bd173004ebd6 req-3a62b7a5-b5ae-4e6c-a3ad-84c6512e8863 service nova] Creating event network-vif-plugged:db9d7b26-9bf6-4842-89a1-604c6eb29592 for instance 48e87855-d184-4691-9f6b-40e2b7d023d1 on hv-cinder-84301 May 24 13:07:38.930100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-740f4c35-c431-4905-893a-bd173004ebd6 req-3a62b7a5-b5ae-4e6c-a3ad-84c6512e8863 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032032 May 24 13:07:38.931011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 369/731] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:39.702709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d1d0c4d6-adda-4262-8e59-7815a3f9b221 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:39.703321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d1d0c4d6-adda-4262-8e59-7815a3f9b221 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:39.709691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4d6-adda-4262-8e59-7815a3f9b221 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:39.710132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4d6-adda-4262-8e59-7815a3f9b221 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:39.710912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4d6-adda-4262-8e59-7815a3f9b221 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:39.711349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4d6-adda-4262-8e59-7815a3f9b221 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:39.850474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d1d0c4d6-adda-4262-8e59-7815a3f9b221 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:39.858107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d1d0c4d6-adda-4262-8e59-7815a3f9b221 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1363 microversion: 2.1 time: 0.159251 May 24 13:07:39.858721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 363/732] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:07:40.875833 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d3dbf39d-ca0a-4a57-8d54-660816f475e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:40.877306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d3dbf39d-ca0a-4a57-8d54-660816f475e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:40.884088 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3dbf39d-ca0a-4a57-8d54-660816f475e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:40.884741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3dbf39d-ca0a-4a57-8d54-660816f475e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:40.885996 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3dbf39d-ca0a-4a57-8d54-660816f475e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:40.887204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d3dbf39d-ca0a-4a57-8d54-660816f475e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:41.032736 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d3dbf39d-ca0a-4a57-8d54-660816f475e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:07:41.040427 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d3dbf39d-ca0a-4a57-8d54-660816f475e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1548 microversion: 2.1 time: 0.169230 May 24 13:07:41.040978 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 370/733] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:07:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:07:41.057291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a8bee6e-ed29-403c-8805-e1abb25b3ca7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:07:41.057797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a8bee6e-ed29-403c-8805-e1abb25b3ca7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:07:41.064871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a8bee6e-ed29-403c-8805-e1abb25b3ca7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:41.065315 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a8bee6e-ed29-403c-8805-e1abb25b3ca7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:41.066078 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a8bee6e-ed29-403c-8805-e1abb25b3ca7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:41.066544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a8bee6e-ed29-403c-8805-e1abb25b3ca7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:41.140884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a8bee6e-ed29-403c-8805-e1abb25b3ca7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087637 May 24 13:07:41.141468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 364/734] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 13:07:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:07:42.061537 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-e110c3ee-8678-4d6b-a944-6360c7e2a8a6 req-c8770a04-d97a-4d6c-86ee-04b13599cfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e87855-d184-4691-9f6b-40e2b7d023d1", "tag": "db9d7b26-9bf6-4842-89a1-604c6eb29592"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:07:42.069508 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=6 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:42.073649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-e110c3ee-8678-4d6b-a944-6360c7e2a8a6 req-c8770a04-d97a-4d6c-86ee-04b13599cfd0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:07:42.074079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-e110c3ee-8678-4d6b-a944-6360c7e2a8a6 req-c8770a04-d97a-4d6c-86ee-04b13599cfd0 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:07:42.086873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-e110c3ee-8678-4d6b-a944-6360c7e2a8a6 req-c8770a04-d97a-4d6c-86ee-04b13599cfd0 service nova] Creating event network-changed:db9d7b26-9bf6-4842-89a1-604c6eb29592 for instance 48e87855-d184-4691-9f6b-40e2b7d023d1 on hv-cinder-84301 May 24 13:07:42.092360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-e110c3ee-8678-4d6b-a944-6360c7e2a8a6 req-c8770a04-d97a-4d6c-86ee-04b13599cfd0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034347 May 24 13:07:42.092983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 371/735] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:08:09.634148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:09.634962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:09.636239 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=5 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:09.636859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=14 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:09.641332 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-20761621-1017-443a-ac1a-20dae71bba4c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:09.641823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-20761621-1017-443a-ac1a-20dae71bba4c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:09.649666 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20761621-1017-443a-ac1a-20dae71bba4c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:09.650106 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20761621-1017-443a-ac1a-20dae71bba4c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:09.650890 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20761621-1017-443a-ac1a-20dae71bba4c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:09.651323 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20761621-1017-443a-ac1a-20dae71bba4c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:09.674434 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-20761621-1017-443a-ac1a-20dae71bba4c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/ips" status: 200 len: 151 microversion: 2.20 time: 0.040346 May 24 13:08:09.674908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 365/736] 10.222.0.45 () {60 vars in 1288 bytes} [Tue May 24 13:08:09 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:08:12.543745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=7 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:12.544541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=49 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:12.548725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7ee552ad-5ec7-4657-acfc-38206d693ba4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:08:12.549348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7ee552ad-5ec7-4657-acfc-38206d693ba4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:12.556949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ee552ad-5ec7-4657-acfc-38206d693ba4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:12.557406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ee552ad-5ec7-4657-acfc-38206d693ba4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:12.558174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ee552ad-5ec7-4657-acfc-38206d693ba4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:12.558679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ee552ad-5ec7-4657-acfc-38206d693ba4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:12.581272 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-7ee552ad-5ec7-4657-acfc-38206d693ba4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lazy-loading 'flavor' on Instance uuid 29462bbf-3714-42f0-893e-fb7de5ca0d2b {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:12.837314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7ee552ad-5ec7-4657-acfc-38206d693ba4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/action" status: 202 len: 0 microversion: 2.20 time: 0.294426 May 24 13:08:12.837925 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 372/737] 10.222.0.45 () {62 vars in 1318 bytes} [Tue May 24 13:08:12 2022] POST /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 13:08:12.846269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:12.847548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:12.854526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:12.855021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:12.855911 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:12.856346 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:12.984262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:12.992954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:12.994490 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:12.995631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b586b940-8d2c-4a75-bd89-b9d8412c3399 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.153419 May 24 13:08:12.996179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 366/738] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:12 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:14.013755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:14.014399 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:14.020681 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:14.021129 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:14.021888 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:14.022349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:14.146752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:14.154594 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:14.156105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:14.157247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5a1cacd3-ad71-4d93-a23e-b26bc8d09bea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.147953 May 24 13:08:14.157802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 373/739] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:14 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:15.176070 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:15.176567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:15.183034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:15.183479 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:15.184231 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:15.184662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:15.318474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:15.326324 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:15.327834 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:15.328989 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c7b7b4a9-218b-4a73-b227-e168401be5ad tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.156927 May 24 13:08:15.329549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 367/740] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:15 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:16.346817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:16.347933 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:16.353991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:16.354483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:16.355254 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:16.355707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:16.490307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:16.498327 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:16.499896 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:16.500983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-db9a10ec-9ded-480b-97f5-a2f0a6dac6e5 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.158079 May 24 13:08:16.501532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 374/741] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:16 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:17.519051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:17.520341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:17.526947 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:17.527422 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:17.528164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:17.528601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:17.667264 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:17.675304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:17.676808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:17.677971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5cdef897-bb35-467e-b838-650ebc49a853 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.162752 May 24 13:08:17.678675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 368/742] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:17 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:18.695783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:18.696443 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:18.702454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:18.702907 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:18.703673 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:18.704116 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:18.827828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:18.835842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:18.837396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:18.838584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f2153436-14f8-433a-b8ad-8173b596846f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.146658 May 24 13:08:18.839142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 375/743] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:18 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:19.857164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:19.857862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:19.865729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:19.866183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:19.866991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:19.867429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:20.001277 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:20.010456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:20.011962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:20.013129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d11f756-a7e7-4937-891e-11947050dfb9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.160139 May 24 13:08:20.013673 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 369/744] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:19 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:21.031089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:21.031709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:21.037768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:21.038221 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:21.039017 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:21.040336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:21.167692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:21.176242 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:21.177812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:21.178926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5c222930-e356-48ca-ab39-6a1e4146d0ff tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.151722 May 24 13:08:21.179474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 376/745] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:21 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:22.196602 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:22.197312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:22.203976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:22.204419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:22.205167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:22.205596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:22.343189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:22.351695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:22.353191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:22.354358 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b6dc93a3-b92d-4a4f-8967-3d2ab7ee9d01 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.162144 May 24 13:08:22.354908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 370/746] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:22 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:23.373016 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:23.373631 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:23.379836 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:23.380286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:23.381046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:23.381513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:23.506083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:23.513944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:23.515643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:23.516971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d5b470a5-4f68-4b82-bb02-520b513382d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.147788 May 24 13:08:23.517600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 377/747] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:23 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:24.535716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:24.536340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:24.542850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:24.543816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:24.544600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:24.545040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:24.683360 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:24.691720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:24.693254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:24.694436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eb5dc40f-eb40-4fda-9ef6-64b9b7630185 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1744 microversion: 2.20 time: 0.162753 May 24 13:08:24.694980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 371/748] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:24 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:25.713022 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:25.713634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:25.719585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:25.720030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:25.720990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:25.721428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:25.854307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:25.862774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:25.864341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:25.865490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cf87f86d-9368-48d7-a014-2d0549d00570 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1744 microversion: 2.20 time: 0.156481 May 24 13:08:25.866101 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 378/749] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:25 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:26.883536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:26.884187 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:26.890776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:26.891174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:26.891941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:26.892384 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:27.023061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:27.031094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:27.032615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:27.033782 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a2d208b-8f5c-46e7-af85-ed0f1116e408 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1744 microversion: 2.20 time: 0.154160 May 24 13:08:27.034361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 372/750] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:26 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:27.149056 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-1c6e6f37-cc8a-4d6a-9bf6-5cc90daf9fb7 req-ba1933cd-3e77-4806-a15b-82385cf69cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29462bbf-3714-42f0-893e-fb7de5ca0d2b", "name": "network-vif-plugged", "status": "completed", "tag": "18ede545-422b-43fc-a7eb-acadacd87ad7"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:08:27.157396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-1c6e6f37-cc8a-4d6a-9bf6-5cc90daf9fb7 req-ba1933cd-3e77-4806-a15b-82385cf69cba service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:27.157977 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-1c6e6f37-cc8a-4d6a-9bf6-5cc90daf9fb7 req-ba1933cd-3e77-4806-a15b-82385cf69cba service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:27.170982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-1c6e6f37-cc8a-4d6a-9bf6-5cc90daf9fb7 req-ba1933cd-3e77-4806-a15b-82385cf69cba service nova] Creating event network-vif-plugged:18ede545-422b-43fc-a7eb-acadacd87ad7 for instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b on hv-cinder-84301 May 24 13:08:27.175966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-1c6e6f37-cc8a-4d6a-9bf6-5cc90daf9fb7 req-ba1933cd-3e77-4806-a15b-82385cf69cba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031392 May 24 13:08:27.176611 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 379/751] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:08:28.051787 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:28.052311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:28.059463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:28.059932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:28.060960 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:28.061567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:28.191067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:28.198833 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:28.200322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:28.201472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-52625fc3-0ad6-4f80-91b2-7082a81e7ccf tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1744 microversion: 2.20 time: 0.153731 May 24 13:08:28.202020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 373/752] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:28 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:29.220030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:29.220730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:29.227522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:29.227975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:29.228741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:29.229180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:29.354181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:29.362336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:29.364421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:29.365575 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-abb863d8-6164-49e2-9273-b97bddebbea1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1744 microversion: 2.20 time: 0.149963 May 24 13:08:29.366131 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 380/753] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:29 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:30.385026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:30.386023 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:30.394946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:30.395488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:30.396343 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:30.396996 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:30.544477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:30.555793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:30.558573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:30.562218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9c43cba7-9b66-47a7-a3a0-5b7d5e2c5174 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1739 microversion: 2.20 time: 0.181473 May 24 13:08:30.567584 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 374/754] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:30 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:08:31.588689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:31.589881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:31.597023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:31.598025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:31.598829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:31.599636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:31.762667 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:31.773793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:31.776258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:31.778163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7acd4488-ec98-4106-978e-d4ab0be61bb6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1739 microversion: 2.20 time: 0.194197 May 24 13:08:31.789413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 381/755] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:31 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:32.799085 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:32.800972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:32.808201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:32.808996 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:32.810015 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:32.810537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:32.952018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:32.962892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:32.965565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:32.967072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b6c1ca7e-4907-4cdc-82f2-6a05bcfc9626 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1739 microversion: 2.20 time: 0.173589 May 24 13:08:32.979446 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 375/756] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:32 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:33.060267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-842243843", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:08:33.112349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.network.neutron [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] validate_networks() for None {{(pid=117643) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:08:33.417676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Flavor limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:08:33.418685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Image limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:08:33.419388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Flavor pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:08:33.419967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Image pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:08:33.420382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:08:33.430402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:33.430989 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:33.431901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:33.432457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:33.458429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Getting quotas for project 51cfc9ec9dcc49c0b16229698640b951. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:08:33.462875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Getting quotas for user b70413462fee46769f9c3f20b1d6881d and project 51cfc9ec9dcc49c0b16229698640b951. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:08:33.476079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Going to run 1 instances... {{(pid=117643) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:08:33.478528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:08:33.525696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-24723da1-4e11-46be-9b3b-ddb86c2c6290 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469101 May 24 13:08:33.526484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 382/757] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:08:33.536525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d3aea77a-1557-4b4e-a72d-28e34d8532b1 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:33.537132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3aea77a-1557-4b4e-a72d-28e34d8532b1 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:33.594562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d3aea77a-1557-4b4e-a72d-28e34d8532b1 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:33.602535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d3aea77a-1557-4b4e-a72d-28e34d8532b1 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1214 microversion: 2.1 time: 0.070222 May 24 13:08:33.612931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 376/758] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:33 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:33.985633 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:33.986252 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:33.993782 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:33.994373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:33.995446 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:33.995883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:34.177284 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:34.186169 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:34.187729 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:34.195313 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a12f4985-6eb1-4681-b163-28547f36462b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1739 microversion: 2.20 time: 0.212359 May 24 13:08:34.198502 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 383/759] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:33 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:34.619945 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-292a8dc1-59bb-4822-aeb4-9c0cebd60c72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:34.620546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-292a8dc1-59bb-4822-aeb4-9c0cebd60c72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:34.626895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-292a8dc1-59bb-4822-aeb4-9c0cebd60c72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:34.627360 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-292a8dc1-59bb-4822-aeb4-9c0cebd60c72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:34.628129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-292a8dc1-59bb-4822-aeb4-9c0cebd60c72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:34.629116 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-292a8dc1-59bb-4822-aeb4-9c0cebd60c72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:34.790274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-292a8dc1-59bb-4822-aeb4-9c0cebd60c72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:34.801001 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-292a8dc1-59bb-4822-aeb4-9c0cebd60c72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1274 microversion: 2.1 time: 0.182568 May 24 13:08:34.801588 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 377/760] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:34 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:35.213585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:35.215074 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:35.221531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:35.221979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:35.223048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:35.223560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:35.369070 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:35.385305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:35.390151 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:35.393047 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-83506736-660d-427f-8b32-52b994446561 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1739 microversion: 2.20 time: 0.183410 May 24 13:08:35.393618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 384/761] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:35 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:08:35.825311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-48ffc320-46bc-4648-8402-7dbcd19d3d4c tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:35.825932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-48ffc320-46bc-4648-8402-7dbcd19d3d4c tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:35.835005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48ffc320-46bc-4648-8402-7dbcd19d3d4c tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:35.837521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48ffc320-46bc-4648-8402-7dbcd19d3d4c tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:35.838409 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48ffc320-46bc-4648-8402-7dbcd19d3d4c tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:35.838856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48ffc320-46bc-4648-8402-7dbcd19d3d4c tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:36.084802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-48ffc320-46bc-4648-8402-7dbcd19d3d4c tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:36.103727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-48ffc320-46bc-4648-8402-7dbcd19d3d4c tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1314 microversion: 2.1 time: 0.282521 May 24 13:08:36.115214 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 378/762] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:35 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:36.432634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:36.434051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:36.440291 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:36.441648 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:36.442679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:36.443336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:36.594751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:36.610794 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:36.613450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:36.614863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-83dce416-b044-4930-87c2-11751a28a888 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1739 microversion: 2.20 time: 0.205084 May 24 13:08:36.616033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 385/763] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:36 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:36.940482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-f5d28f70-7dee-44fd-bf67-f39e09d07d06 req-d09ee5b9-ef0e-4917-b87c-9361229cf845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319c61a7-dfdc-4118-8018-7b7219b78879", "tag": "882ab510-0d30-4679-ba41-3b0ac24f0ceb"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:08:36.956147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-f5d28f70-7dee-44fd-bf67-f39e09d07d06 req-d09ee5b9-ef0e-4917-b87c-9361229cf845 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:36.956946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-f5d28f70-7dee-44fd-bf67-f39e09d07d06 req-d09ee5b9-ef0e-4917-b87c-9361229cf845 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:36.980239 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-f5d28f70-7dee-44fd-bf67-f39e09d07d06 req-d09ee5b9-ef0e-4917-b87c-9361229cf845 service nova] Creating event network-changed:882ab510-0d30-4679-ba41-3b0ac24f0ceb for instance 319c61a7-dfdc-4118-8018-7b7219b78879 on hv-cinder-84301 May 24 13:08:36.991775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-f5d28f70-7dee-44fd-bf67-f39e09d07d06 req-d09ee5b9-ef0e-4917-b87c-9361229cf845 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058987 May 24 13:08:36.993771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 379/764] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:08:37.121180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-771d31ec-73c9-41f5-899c-b870aea052de tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:37.121904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-771d31ec-73c9-41f5-899c-b870aea052de tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:37.135083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-771d31ec-73c9-41f5-899c-b870aea052de tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:37.135646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-771d31ec-73c9-41f5-899c-b870aea052de tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:37.136514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-771d31ec-73c9-41f5-899c-b870aea052de tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:37.137032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-771d31ec-73c9-41f5-899c-b870aea052de tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:37.286355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-771d31ec-73c9-41f5-899c-b870aea052de tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:37.295743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-771d31ec-73c9-41f5-899c-b870aea052de tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1314 microversion: 2.1 time: 0.178418 May 24 13:08:37.306466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 386/765] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:37 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:37.634308 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:37.637685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:37.648100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:37.648553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:37.649333 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:37.650992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:37.828849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:37.838899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:37.840590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:37.841913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a0bac145-bd25-4ca9-9269-ca27d31546a9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1739 microversion: 2.20 time: 0.212193 May 24 13:08:37.842586 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 380/766] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:37 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:38.313057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5451e0e3-82a4-4887-a391-cca7e1618252 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:38.314572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5451e0e3-82a4-4887-a391-cca7e1618252 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:38.321502 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5451e0e3-82a4-4887-a391-cca7e1618252 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:38.322236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5451e0e3-82a4-4887-a391-cca7e1618252 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:38.323193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5451e0e3-82a4-4887-a391-cca7e1618252 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:38.323803 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5451e0e3-82a4-4887-a391-cca7e1618252 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:38.469824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5451e0e3-82a4-4887-a391-cca7e1618252 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:38.473930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:38.480980 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5451e0e3-82a4-4887-a391-cca7e1618252 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1314 microversion: 2.1 time: 0.171793 May 24 13:08:38.482933 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 387/767] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:38 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:38.859349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:38.860685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:38.868187 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:38.868642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:38.869478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:38.870115 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:39.010275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:39.020208 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:39.021861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:39.023342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2cac7b3b-0fd7-4e5c-bacb-3715add264fb tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1739 microversion: 2.20 time: 0.167916 May 24 13:08:39.024205 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 381/768] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:38 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:39.500089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5d55bb49-1b50-458a-ac8d-30e1f2b1c36d tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:39.500638 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5d55bb49-1b50-458a-ac8d-30e1f2b1c36d tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:39.512518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d55bb49-1b50-458a-ac8d-30e1f2b1c36d tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:39.513297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d55bb49-1b50-458a-ac8d-30e1f2b1c36d tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:39.514065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d55bb49-1b50-458a-ac8d-30e1f2b1c36d tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:39.514522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d55bb49-1b50-458a-ac8d-30e1f2b1c36d tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:39.658080 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5d55bb49-1b50-458a-ac8d-30e1f2b1c36d tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:39.666641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5d55bb49-1b50-458a-ac8d-30e1f2b1c36d tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1314 microversion: 2.1 time: 0.171502 May 24 13:08:39.667156 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 388/769] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:39 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:40.041452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:40.041993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:40.044971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=37 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:40.051243 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:40.051913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:40.052995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:40.053492 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:40.058018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=91 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:40.252899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:40.260774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:40.262269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:40.263442 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9c24355f-2518-48ed-8b5e-2db094e4de10 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1739 microversion: 2.20 time: 0.225968 May 24 13:08:40.263987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 382/770] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:40 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:40.685302 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3aec791a-a324-400c-ba4a-315fe6e3aadd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:40.685811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3aec791a-a324-400c-ba4a-315fe6e3aadd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:40.692369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3aec791a-a324-400c-ba4a-315fe6e3aadd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:40.692811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3aec791a-a324-400c-ba4a-315fe6e3aadd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:40.693564 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3aec791a-a324-400c-ba4a-315fe6e3aadd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:40.693997 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3aec791a-a324-400c-ba4a-315fe6e3aadd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:40.822615 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3aec791a-a324-400c-ba4a-315fe6e3aadd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:40.829944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3aec791a-a324-400c-ba4a-315fe6e3aadd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1314 microversion: 2.1 time: 0.148621 May 24 13:08:40.830547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 389/771] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:40 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:41.240189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-ef730716-430a-4184-b551-feb08be01825 req-fdfc5b80-a235-4557-a096-82793d54553e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319c61a7-dfdc-4118-8018-7b7219b78879", "name": "network-vif-plugged", "status": "completed", "tag": "882ab510-0d30-4679-ba41-3b0ac24f0ceb"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:08:41.249210 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ef730716-430a-4184-b551-feb08be01825 req-fdfc5b80-a235-4557-a096-82793d54553e service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:41.249699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ef730716-430a-4184-b551-feb08be01825 req-fdfc5b80-a235-4557-a096-82793d54553e service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:41.263707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-ef730716-430a-4184-b551-feb08be01825 req-fdfc5b80-a235-4557-a096-82793d54553e service nova] Creating event network-vif-plugged:882ab510-0d30-4679-ba41-3b0ac24f0ceb for instance 319c61a7-dfdc-4118-8018-7b7219b78879 on hv-cinder-84301 May 24 13:08:41.268724 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-ef730716-430a-4184-b551-feb08be01825 req-fdfc5b80-a235-4557-a096-82793d54553e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 May 24 13:08:41.269395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 383/772] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:08:41.281972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:41.283016 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:41.290627 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:41.291170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:41.291987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:41.292432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:41.469831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:41.478734 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:41.480236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:41.481399 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b74b23dd-31dc-474a-9621-37ef26b1e0e6 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1721 microversion: 2.20 time: 0.204431 May 24 13:08:41.481962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 390/773] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:41 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:08:41.847890 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8031072f-95bc-4b4c-a16c-7a01cc3c312f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:41.848506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8031072f-95bc-4b4c-a16c-7a01cc3c312f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:41.854753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8031072f-95bc-4b4c-a16c-7a01cc3c312f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:41.855199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8031072f-95bc-4b4c-a16c-7a01cc3c312f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:41.855945 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8031072f-95bc-4b4c-a16c-7a01cc3c312f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:41.856405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8031072f-95bc-4b4c-a16c-7a01cc3c312f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:41.982312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8031072f-95bc-4b4c-a16c-7a01cc3c312f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:41.989992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8031072f-95bc-4b4c-a16c-7a01cc3c312f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1314 microversion: 2.1 time: 0.146976 May 24 13:08:41.990590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 384/774] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:41 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:42.500711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:42.501320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:42.507923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:42.508373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:42.509123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:42.509621 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:42.636307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:42.644218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:42.645723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:42.646909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-71c1afe8-dd1f-4b37-ab69-d2878c39da0d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1721 microversion: 2.20 time: 0.150090 May 24 13:08:42.647461 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 391/775] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:42 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:43.006958 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a9f2765d-464a-489f-bdcf-0df3babce55f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:43.007842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a9f2765d-464a-489f-bdcf-0df3babce55f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:43.014308 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9f2765d-464a-489f-bdcf-0df3babce55f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:43.014774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9f2765d-464a-489f-bdcf-0df3babce55f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:43.015525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9f2765d-464a-489f-bdcf-0df3babce55f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:43.015956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9f2765d-464a-489f-bdcf-0df3babce55f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:43.145581 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a9f2765d-464a-489f-bdcf-0df3babce55f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:43.153094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a9f2765d-464a-489f-bdcf-0df3babce55f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1314 microversion: 2.1 time: 0.150490 May 24 13:08:43.153657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 385/776] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:43 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:43.443868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-de66cb17-b8f0-4c22-b9ad-726967f755ce req-245df008-18ec-439e-a9fa-11366f4795f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29462bbf-3714-42f0-893e-fb7de5ca0d2b", "name": "network-vif-unplugged", "status": "completed", "tag": "18ede545-422b-43fc-a7eb-acadacd87ad7"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:08:43.447381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:43.448037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:43.454481 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-de66cb17-b8f0-4c22-b9ad-726967f755ce req-245df008-18ec-439e-a9fa-11366f4795f6 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:43.454940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-de66cb17-b8f0-4c22-b9ad-726967f755ce req-245df008-18ec-439e-a9fa-11366f4795f6 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:43.467139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-de66cb17-b8f0-4c22-b9ad-726967f755ce req-245df008-18ec-439e-a9fa-11366f4795f6 service nova] Creating event network-vif-unplugged:18ede545-422b-43fc-a7eb-acadacd87ad7 for instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b on hv-cinder-84301 May 24 13:08:43.470789 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=6 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:43.472741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-de66cb17-b8f0-4c22-b9ad-726967f755ce req-245df008-18ec-439e-a9fa-11366f4795f6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033014 May 24 13:08:43.473317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 392/777] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:08:43.665239 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:43.665586 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:43.667629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:43.673310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:43.673781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:43.674583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:43.675017 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:43.804357 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:43.812198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:43.813738 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:43.814926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b0364ad-6b2d-4ef6-8702-7f59e764a246 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1721 microversion: 2.20 time: 0.153893 May 24 13:08:43.815470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 386/778] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:43 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:44.170586 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dfb3f515-1eba-41d6-9011-9ad1f0d46291 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:44.171282 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dfb3f515-1eba-41d6-9011-9ad1f0d46291 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:44.178695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dfb3f515-1eba-41d6-9011-9ad1f0d46291 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:44.179086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dfb3f515-1eba-41d6-9011-9ad1f0d46291 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:44.179838 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dfb3f515-1eba-41d6-9011-9ad1f0d46291 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:44.180269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dfb3f515-1eba-41d6-9011-9ad1f0d46291 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:44.309663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dfb3f515-1eba-41d6-9011-9ad1f0d46291 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:44.317692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dfb3f515-1eba-41d6-9011-9ad1f0d46291 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1314 microversion: 2.1 time: 0.151161 May 24 13:08:44.318273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 393/779] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:44 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:44.834355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:44.834963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:44.841368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:44.841811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:44.842587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:44.843019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:44.971714 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:44.979814 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:44.981312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:44.982500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8ede0d0a-99d2-41c2-813e-fe6a61814939 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1664 microversion: 2.20 time: 0.152544 May 24 13:08:44.983046 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 387/780] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:44 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:45.000164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2c40407b-2076-40a1-9f50-2090a682a6db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b82b2030-5d64-4b3d-9cfa-fb0fa9dce808"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:08:45.001259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2c40407b-2076-40a1-9f50-2090a682a6db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:45.007823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c40407b-2076-40a1-9f50-2090a682a6db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.008270 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c40407b-2076-40a1-9f50-2090a682a6db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.009057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c40407b-2076-40a1-9f50-2090a682a6db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.009492 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c40407b-2076-40a1-9f50-2090a682a6db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.287412 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2c40407b-2076-40a1-9f50-2090a682a6db tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291101 May 24 13:08:45.288170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 394/781] 10.222.0.45 () {62 vars in 1363 bytes} [Tue May 24 13:08:44 2022] POST /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:08:45.342842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-073385fa-11c9-4619-a964-3dbb4cd8bd72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:45.343582 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-073385fa-11c9-4619-a964-3dbb4cd8bd72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:45.350795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073385fa-11c9-4619-a964-3dbb4cd8bd72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.351317 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073385fa-11c9-4619-a964-3dbb4cd8bd72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.352006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073385fa-11c9-4619-a964-3dbb4cd8bd72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.352576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073385fa-11c9-4619-a964-3dbb4cd8bd72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.404301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-739a1e50-6475-423f-aaec-78b41de412c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:45.404938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-739a1e50-6475-423f-aaec-78b41de412c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:45.411704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-739a1e50-6475-423f-aaec-78b41de412c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.412158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-739a1e50-6475-423f-aaec-78b41de412c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.412964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-739a1e50-6475-423f-aaec-78b41de412c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.413386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-739a1e50-6475-423f-aaec-78b41de412c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.482153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-073385fa-11c9-4619-a964-3dbb4cd8bd72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:45.490628 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-073385fa-11c9-4619-a964-3dbb4cd8bd72 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1463 microversion: 2.1 time: 0.160173 May 24 13:08:45.491188 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 388/782] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:45 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:45.535507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d16d6f12-7b25-4928-8b21-f851d5e00a35 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:45.535993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d16d6f12-7b25-4928-8b21-f851d5e00a35 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:45.541933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d16d6f12-7b25-4928-8b21-f851d5e00a35 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.542418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d16d6f12-7b25-4928-8b21-f851d5e00a35 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.543185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d16d6f12-7b25-4928-8b21-f851d5e00a35 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.543622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d16d6f12-7b25-4928-8b21-f851d5e00a35 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.569164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d16d6f12-7b25-4928-8b21-f851d5e00a35 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:08:45.645674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-739a1e50-6475-423f-aaec-78b41de412c1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/os-volume_attachments/b82b2030-5d64-4b3d-9cfa-fb0fa9dce808" status: 202 len: 0 microversion: 2.20 time: 0.244867 May 24 13:08:45.645959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d16d6f12-7b25-4928-8b21-f851d5e00a35 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "DELETE /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 204 len: 0 microversion: 2.1 time: 0.114613 May 24 13:08:45.646746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 389/784] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:08:45 2022] DELETE /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:08:45.646862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 395/784] 10.222.0.45 () {60 vars in 1456 bytes} [Tue May 24 13:08:45 2022] DELETE /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/os-volume_attachments/b82b2030-5d64-4b3d-9cfa-fb0fa9dce808 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 24 13:08:45.655326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f600f766-2d47-4ac4-8808-99783e45cf7f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:45.655942 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f600f766-2d47-4ac4-8808-99783e45cf7f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:45.662613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f600f766-2d47-4ac4-8808-99783e45cf7f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.663065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f600f766-2d47-4ac4-8808-99783e45cf7f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.663829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f600f766-2d47-4ac4-8808-99783e45cf7f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.664265 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f600f766-2d47-4ac4-8808-99783e45cf7f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.702653 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0478d040-40c2-4ff9-9582-7b00a0abd33e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:08:45.703301 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0478d040-40c2-4ff9-9582-7b00a0abd33e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:45.709912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0478d040-40c2-4ff9-9582-7b00a0abd33e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.710388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0478d040-40c2-4ff9-9582-7b00a0abd33e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.711151 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0478d040-40c2-4ff9-9582-7b00a0abd33e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.711698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0478d040-40c2-4ff9-9582-7b00a0abd33e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.792540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f600f766-2d47-4ac4-8808-99783e45cf7f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:45.800761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f600f766-2d47-4ac4-8808-99783e45cf7f tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1469 microversion: 2.1 time: 0.149341 May 24 13:08:45.801340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 396/785] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:45 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:45.806902 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0478d040-40c2-4ff9-9582-7b00a0abd33e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "POST /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/action" status: 202 len: 0 microversion: 2.20 time: 0.108255 May 24 13:08:45.807985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 390/786] 10.222.0.45 () {62 vars in 1318 bytes} [Tue May 24 13:08:45 2022] POST /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 24 13:08:45.815651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:45.816908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:45.823122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.823568 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.824322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:45.824753 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:45.962165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:45.970166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:45.971719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:45.973389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1383285c-000a-43db-af53-dc928fb5586f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1672 microversion: 2.20 time: 0.161493 May 24 13:08:45.973950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 397/787] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:45 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:08:46.819263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b1f7a8f3-8185-4d31-aeb0-2ab75a6da82a tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:46.819868 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b1f7a8f3-8185-4d31-aeb0-2ab75a6da82a tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:46.826872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1f7a8f3-8185-4d31-aeb0-2ab75a6da82a tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:46.827353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1f7a8f3-8185-4d31-aeb0-2ab75a6da82a tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:46.828159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1f7a8f3-8185-4d31-aeb0-2ab75a6da82a tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:46.828591 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1f7a8f3-8185-4d31-aeb0-2ab75a6da82a tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:46.962511 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b1f7a8f3-8185-4d31-aeb0-2ab75a6da82a tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:46.970068 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b1f7a8f3-8185-4d31-aeb0-2ab75a6da82a tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1469 microversion: 2.1 time: 0.155432 May 24 13:08:46.970662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 391/788] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:46 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:46.992190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:46.992801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:46.998862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:46.999312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:47.000068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:47.000505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:47.126463 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:47.136084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:47.137592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:47.138826 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-523481c0-20b7-42a0-87c6-8ec6a7b7a0de tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.150997 May 24 13:08:47.139578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 398/789] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:46 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:47.964957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-9280c7de-6f68-407d-9483-98628d947a6f req-db766cca-bc67-4527-b387-d742f03a49fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319c61a7-dfdc-4118-8018-7b7219b78879", "name": "network-vif-deleted", "tag": "882ab510-0d30-4679-ba41-3b0ac24f0ceb"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:08:47.974709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9280c7de-6f68-407d-9483-98628d947a6f req-db766cca-bc67-4527-b387-d742f03a49fa service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:47.975155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9280c7de-6f68-407d-9483-98628d947a6f req-db766cca-bc67-4527-b387-d742f03a49fa service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:47.986215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-9280c7de-6f68-407d-9483-98628d947a6f req-db766cca-bc67-4527-b387-d742f03a49fa service nova] Creating event network-vif-deleted:882ab510-0d30-4679-ba41-3b0ac24f0ceb for instance 319c61a7-dfdc-4118-8018-7b7219b78879 on hv-cinder-84301 May 24 13:08:47.986411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-730dfabb-f54a-4092-b23c-34a26f653a64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:47.987333 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-730dfabb-f54a-4092-b23c-34a26f653a64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:47.991496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-9280c7de-6f68-407d-9483-98628d947a6f req-db766cca-bc67-4527-b387-d742f03a49fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030436 May 24 13:08:47.992084 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 392/790] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:08:47.994007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-730dfabb-f54a-4092-b23c-34a26f653a64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:47.994526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-730dfabb-f54a-4092-b23c-34a26f653a64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:47.995354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-730dfabb-f54a-4092-b23c-34a26f653a64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:47.995846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-730dfabb-f54a-4092-b23c-34a26f653a64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:48.063007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-730dfabb-f54a-4092-b23c-34a26f653a64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:48.071391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-730dfabb-f54a-4092-b23c-34a26f653a64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1427 microversion: 2.1 time: 0.088828 May 24 13:08:48.071965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 399/791] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:47 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:08:48.157510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:48.158211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:48.164530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:48.164986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:48.165755 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:48.166195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:48.301319 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:48.310388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:48.311956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:48.313350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-24fcc4d0-928d-4b89-86b2-79132fbad293 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.160068 May 24 13:08:48.313807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 393/792] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:48 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:49.091320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:49.091979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:49.100413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:49.101154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:49.102100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:49.102749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:49.122428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:49.137130 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:49.137591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:49.138040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:49.178825 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:49.186350 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-acd72a11-a652-4971-ae78-7865ee59dcc5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.098854 May 24 13:08:49.186920 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 400/793] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:49 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:49.332770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:49.333393 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:49.341966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:49.342379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:49.343169 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:49.343613 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:49.492801 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:49.501662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:49.504114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:49.505413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bc1dc3f4-ae77-4163-bad6-7c42097b1b99 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.177159 May 24 13:08:49.518631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 394/794] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:49 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:50.203241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:50.203847 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:50.209971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:50.210450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:50.211202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:50.211633 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:50.242801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:50.243249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:50.243895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:50.291087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:50.301080 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e83f5553-5754-42eb-a810-15e6e09ff218 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.101037 May 24 13:08:50.302064 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 401/795] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:50 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:50.525519 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:50.526060 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:50.532558 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:50.533003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:50.533764 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:50.534197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:50.671110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:50.679808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:50.681329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:50.682546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8e29c84d-53d9-4cc6-8feb-afb9657754dc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.161017 May 24 13:08:50.683110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 395/796] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:50 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:51.319256 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:51.320743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:51.327837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:51.328376 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:51.329221 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:51.329659 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:51.366810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:51.367605 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:51.368131 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:51.420301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:51.428727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1d2698a9-fc39-4687-8ad7-7bce8e58582e tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.114522 May 24 13:08:51.429296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 402/797] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:51 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:51.700920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:51.701464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:51.708881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:51.709540 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:51.710459 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:51.710966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:51.851306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:51.859285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:51.860793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:51.862219 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5bea6f4f-2a55-4ea1-aadd-3838dcbb6914 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.165046 May 24 13:08:51.863476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 396/798] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:51 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:52.445844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:52.446512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:52.453142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:52.453599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:52.457403 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:52.457902 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:52.489859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:52.490331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:52.490790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:52.530791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:52.537995 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6520e16f-1e2b-4f68-99af-ebf6fb203974 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.096034 May 24 13:08:52.538785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 403/799] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:52 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:52.883611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:52.885169 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:52.894377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:52.895048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:52.895950 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:52.896605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:52.912330 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:53.028934 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:53.036983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:53.038538 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:53.039707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-609bcc2d-86e7-4409-9d9d-a9345dabe01d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.162177 May 24 13:08:53.040263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 397/800] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:52 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:53.554862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:53.555479 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:53.561633 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:53.562078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:53.562866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:53.563325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:53.593455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:53.593903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:53.594384 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:53.634183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:53.641515 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3e980c5b-829e-4431-b5f3-5976baaa71d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.090563 May 24 13:08:53.642087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 404/801] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:53 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:54.060216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:54.061483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:54.069135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:54.069679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:54.070546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:54.071048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:54.204884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:54.216569 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:54.218254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:54.219714 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3ddaa67d-eaec-493a-b150-97d4c06f59f9 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.164567 May 24 13:08:54.227195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 398/802] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:54 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:54.658774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:54.659840 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:54.665989 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:54.666471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:54.667231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:54.667705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:54.697245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:54.697693 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:54.698145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:54.751396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:54.761965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9221a6bf-fc90-4daa-bd92-846f674be5b3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.106760 May 24 13:08:54.763353 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 405/803] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:54 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:55.238762 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:55.239509 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:55.246703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:55.247154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:55.247928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:55.248366 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:55.402638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:55.412250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:55.413929 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:55.415310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5ffc644a-4612-451f-9eb0-900ac44220d3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.181618 May 24 13:08:55.424451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 399/804] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:55 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:55.778512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:55.779151 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:55.785264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:55.785709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:55.786497 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:55.786930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:55.820153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:55.820598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:55.821042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:55.859535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:55.867545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1220848c-52ab-4d03-a0b2-c76a4ec250d5 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.092956 May 24 13:08:55.868042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 406/805] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:55 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:56.434976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:56.435587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:56.442209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:56.442693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:56.443458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:56.443891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:56.569189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:56.577040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:56.578564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:56.579744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-966f29a2-1a78-43f2-8354-ff18b0180648 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.148656 May 24 13:08:56.580432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 400/806] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:56 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:56.885106 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:56.886914 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:56.895930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:56.897055 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:56.898395 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:56.899205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:56.933449 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:56.933911 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:56.934456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:56.980003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:56.987821 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d7e90e6e-2862-4fa3-ad11-d912d5d80c64 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.107305 May 24 13:08:56.988387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 407/807] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:56 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:08:57.598518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:57.599123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:57.605638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:57.606081 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:57.606860 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:57.607291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:57.745808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:57.754653 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:57.756198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:57.757355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-16b52bcf-512b-4c3a-a663-de311f43bbea tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.162796 May 24 13:08:57.757914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 401/808] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:57 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:58.005423 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:58.005993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:58.012133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:58.012587 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:58.013360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:58.013802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:58.043894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:58.044335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:58.044776 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:58.088231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:58.099177 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ffddaede-c9c1-476c-b5a2-b77123b4f80b tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.098310 May 24 13:08:58.109378 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 408/809] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:57 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:58.775905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:58.776516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:58.782983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:58.783428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:58.784175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:58.785286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:58.948849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:58.957433 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:58.959038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:58.960198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2b466273-b4ef-4682-932d-013ea4326299 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.188305 May 24 13:08:58.960755 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 402/810] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:58 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:08:59.118002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:59.118674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:59.124725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:59.125179 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:59.125952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:59.126429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:59.157748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:59.158121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:59.158609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:08:59.200625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:08:59.208512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1deb514f-acbc-44d7-84b9-91c5390e80c6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.094446 May 24 13:08:59.209065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 409/811] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:08:59 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:08:59.978906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:08:59.979515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:08:59.985992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:59.986478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:08:59.987566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:08:59.988501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:00.116841 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:00.124784 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:00.126305 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:00.127463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1435464e-b2fb-4544-a94e-31a6a656ee1f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.152482 May 24 13:09:00.128026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 403/812] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:08:59 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:00.225203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:00.225814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:00.231759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:00.232205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:00.232956 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:00.233386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:00.263011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:00.263457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:00.263898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:09:00.304053 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:00.311384 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-33aa4cc5-caf3-4ddb-bb42-f515dd87a1f6 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.090470 May 24 13:09:00.311941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 410/813] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:00 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:01.144853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:01.145459 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:01.151901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:01.152345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:01.153098 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:01.153539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:01.279082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:01.286951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:01.288445 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:01.289589 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4ea5d5e3-4813-4603-b3a3-4dda54f017f2 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.148651 May 24 13:09:01.290135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 404/814] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:01 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:01.327799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:01.328411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:01.334330 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:01.334776 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:01.335534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:01.335964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:01.366458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:01.366898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:01.367341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lazy-loading 'fault' on Instance uuid 319c61a7-dfdc-4118-8018-7b7219b78879 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:09:01.407015 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b70413462fee46769f9c3f20b1d6881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cfc9ec9dcc49c0b16229698640b951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:01.414728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2ade2745-6ff4-4e34-9890-a5b4263146fd tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 200 len: 1304 microversion: 2.1 time: 0.090781 May 24 13:09:01.415290 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 411/815] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:01 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:02.309183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:02.309854 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:02.316463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:02.316920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:02.318596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:02.319084 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:02.431058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:02.431680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] [instance: 319c61a7-dfdc-4118-8018-7b7219b78879] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:02.437542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:02.437991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:02.438797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:02.439242 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:02.446444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:02.453257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] HTTP exception thrown: Instance 319c61a7-dfdc-4118-8018-7b7219b78879 could not be found. May 24 13:09:02.454421 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Request method failure captured: May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 HTTP/1.1 May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNjP9Wzn0jm5esRsqaBxkgxcwyfXFLvnCyNwYiqVWa4ROELwNk38AsYfCDLhyednRSjbRs-kKexpAPiZXKPt40agtr99Y6-UczVlk6jXuLKKaavJbM8uC4RtMNJcUdJ4DwlpUTLNwZSz8whEtXmZD9hQGO2LJ21vzg8HYWC9I4O0pFc May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 51cfc9ec9dcc49c0b16229698640b951 May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-VolumesNegativeTest-1852188403 May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:09:02.454973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51cfc9ec9dcc49c0b16229698640b951"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51cfc9ec9dcc49c0b16229698640b951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51cfc9ec9dcc49c0b16229698640b951"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51cfc9ec9dcc49c0b16229698640b951"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-VolumesNegativeTest-1852188403 May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 51cfc9ec9dcc49c0b16229698640b951 May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-VolumesNegativeTest-1852188403 May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-VolumesNegativeTest-1852188403-project May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: b70413462fee46769f9c3f20b1d6881d May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-VolumesNegativeTest-1852188403-project May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 319c61a7-dfdc-4118-8018-7b7219b78879 could not be found. May 24 13:09:02.456614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '319c61a7-dfdc-4118-8018-7b7219b78879'} May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319c61a7-dfdc-4118-8018-7b7219b78879 could not be found. May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:09:02.457469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319c61a7-dfdc-4118-8018-7b7219b78879 could not be found. May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319c61a7-dfdc-4118-8018-7b7219b78879 could not be found. May 24 13:09:02.459389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:09:02.460526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] Returning 404 to user: Instance 319c61a7-dfdc-4118-8018-7b7219b78879 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:09:02.460635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:02.460784 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-adc7ad4c-8d49-4a0b-954f-dd576e4798e3 tempest-VolumesNegativeTest-1852188403 tempest-VolumesNegativeTest-1852188403-project] 10.222.0.45 "GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879" status: 404 len: 111 microversion: 2.1 time: 0.029166 May 24 13:09:02.460784 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 412/816] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:02 2022] GET /compute/v2.1/servers/319c61a7-dfdc-4118-8018-7b7219b78879 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 13:09:02.460977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fa8eecad-4198-4128-b96e-db53d6f63d54 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.151844 May 24 13:09:02.460977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 405/817] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:02 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:03.479282 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:03.479908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:03.485979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:03.486483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:03.487519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:03.487965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:03.502471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:03.617099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:03.625057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:03.626698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:03.627855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dbc904b1-1602-409b-9321-adb86eeffbb0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.152494 May 24 13:09:03.628397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 413/818] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:03 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:09:04.648295 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:04.648909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:04.655247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:04.655691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:04.656452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:04.656882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:04.797821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:04.806153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:04.807716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:04.808966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-04d62acc-17c0-4f3b-a198-6f8c352ab70c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.165952 May 24 13:09:04.809669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 406/819] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:04 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:05.055287 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2f9ed283-48fc-47ca-9de4-8308050986b3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:05.055757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2f9ed283-48fc-47ca-9de4-8308050986b3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:05.061837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f9ed283-48fc-47ca-9de4-8308050986b3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:05.062308 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f9ed283-48fc-47ca-9de4-8308050986b3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:05.063084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f9ed283-48fc-47ca-9de4-8308050986b3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:05.063527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f9ed283-48fc-47ca-9de4-8308050986b3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:05.086170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2f9ed283-48fc-47ca-9de4-8308050986b3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/ips" status: 200 len: 144 microversion: 2.1 time: 0.034939 May 24 13:09:05.086781 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 414/820] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 13:09:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/ips => generated 144 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:09:05.826871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:05.827481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:05.833923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:05.834410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:05.835174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:05.835617 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:05.980225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:05.988502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:05.990970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:05.992136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2fa3fb50-e3d9-4ac3-932f-021f0222d042 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.169232 May 24 13:09:05.992720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 407/821] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:05 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:06.400708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d13c777b-249a-4d3f-b957-75bfddc95a18 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb299a3c-ee5e-487b-b0ef-db0d627839ef"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:09:06.402106 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d13c777b-249a-4d3f-b957-75bfddc95a18 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:06.409285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d13c777b-249a-4d3f-b957-75bfddc95a18 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:06.409742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d13c777b-249a-4d3f-b957-75bfddc95a18 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:06.410557 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d13c777b-249a-4d3f-b957-75bfddc95a18 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:06.411636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d13c777b-249a-4d3f-b957-75bfddc95a18 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:06.675871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d13c777b-249a-4d3f-b957-75bfddc95a18 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279268 May 24 13:09:06.676560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 415/822] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 13:09:06 2022] POST /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:09:07.012544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:07.013167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:07.020151 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:07.020326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:07.021243 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:07.021603 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:07.158236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:07.170165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:07.171547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:07.172712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-59dfc275-77ca-4178-8f71-12a5764400f3 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.165572 May 24 13:09:07.173270 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 408/823] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:07 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:08.193753 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:08.195726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:08.202385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:08.202838 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:08.203603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:08.204040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:08.453563 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:08.465297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:08.467393 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:08.468742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1df295fb-d544-4f34-ade8-71f55239e046 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.280578 May 24 13:09:08.469584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 416/824] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:08 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:09.424571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-03769193-1a20-4fe0-a3cd-06f335b7c627 req-3732d614-f626-4c66-ad3e-38e53f48942e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29462bbf-3714-42f0-893e-fb7de5ca0d2b", "name": "network-vif-plugged", "status": "completed", "tag": "18ede545-422b-43fc-a7eb-acadacd87ad7"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:09:09.434953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-03769193-1a20-4fe0-a3cd-06f335b7c627 req-3732d614-f626-4c66-ad3e-38e53f48942e service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:09.435405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-03769193-1a20-4fe0-a3cd-06f335b7c627 req-3732d614-f626-4c66-ad3e-38e53f48942e service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:09.455082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-03769193-1a20-4fe0-a3cd-06f335b7c627 req-3732d614-f626-4c66-ad3e-38e53f48942e service nova] Creating event network-vif-plugged:18ede545-422b-43fc-a7eb-acadacd87ad7 for instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b on hv-cinder-84301 May 24 13:09:09.461733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-03769193-1a20-4fe0-a3cd-06f335b7c627 req-3732d614-f626-4c66-ad3e-38e53f48942e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040813 May 24 13:09:09.462640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 409/825] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:09:09.490720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:09.492651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:09.500224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:09.500866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:09.501971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:09.502765 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:09.764985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:09.777298 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:09.780133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:09.786310 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-887ce5d5-43e0-416e-9a6f-b789629957e1 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.299653 May 24 13:09:09.790269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 417/826] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:09 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:10.807901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:10.809170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:10.814977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:10.817319 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:10.818054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:10.819027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:10.819626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:11.068448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:11.076901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:11.078454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:11.079704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3c5cf4c0-6ed1-4ff0-bee7-3355aba370f4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.276670 May 24 13:09:11.080515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 410/827] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:10 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:12.099432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:12.100111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:12.109421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:12.110027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:12.111089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:12.111734 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:12.313367 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:12.322501 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:12.327102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:12.331441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6d7a6312-d8e2-4c96-ae00-c8f63ebb5d2a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1730 microversion: 2.20 time: 0.236229 May 24 13:09:12.332160 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 418/828] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:12 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:09:13.352863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:13.353584 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:13.365686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:13.366417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:13.367924 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:13.368516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:13.537793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:13.547980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:13.549778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:13.551935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-54f2c8e4-982d-471c-91da-f4689fdb72c7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1717 microversion: 2.20 time: 0.203919 May 24 13:09:13.552689 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 411/829] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:09:13 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1717 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:09:14.289114 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d53fe125-e77c-4ec4-b34e-391528fb2e49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:14.290213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d53fe125-e77c-4ec4-b34e-391528fb2e49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:14.293071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=78 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:14.299707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d53fe125-e77c-4ec4-b34e-391528fb2e49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:14.300592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d53fe125-e77c-4ec4-b34e-391528fb2e49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:14.301688 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d53fe125-e77c-4ec4-b34e-391528fb2e49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:14.302394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d53fe125-e77c-4ec4-b34e-391528fb2e49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:14.336741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d53fe125-e77c-4ec4-b34e-391528fb2e49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051934 May 24 13:09:14.337326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 419/830] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:09:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:09:14.347505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7ad677a6-b5c4-4bc4-982e-0ff9ae3edc0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:14.348003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7ad677a6-b5c4-4bc4-982e-0ff9ae3edc0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:14.354672 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ad677a6-b5c4-4bc4-982e-0ff9ae3edc0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:14.355388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ad677a6-b5c4-4bc4-982e-0ff9ae3edc0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:14.355926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ad677a6-b5c4-4bc4-982e-0ff9ae3edc0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:14.356530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ad677a6-b5c4-4bc4-982e-0ff9ae3edc0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:14.397294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7ad677a6-b5c4-4bc4-982e-0ff9ae3edc0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments/bb299a3c-ee5e-487b-b0ef-db0d627839ef" status: 200 len: 194 microversion: 2.1 time: 0.053698 May 24 13:09:14.398564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 412/831] 10.222.0.45 () {58 vars in 1412 bytes} [Tue May 24 13:09:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments/bb299a3c-ee5e-487b-b0ef-db0d627839ef => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:09:15.959449 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-237f5fa2-c999-4df2-a855-7bb213d79d4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce1a3b45-06f5-40d2-aaa9-fa923b8bd334"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:09:15.960683 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-237f5fa2-c999-4df2-a855-7bb213d79d4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:15.975370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-237f5fa2-c999-4df2-a855-7bb213d79d4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:15.979386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-237f5fa2-c999-4df2-a855-7bb213d79d4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:15.985408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-237f5fa2-c999-4df2-a855-7bb213d79d4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:15.988548 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-237f5fa2-c999-4df2-a855-7bb213d79d4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:16.594528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-237f5fa2-c999-4df2-a855-7bb213d79d4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646045 May 24 13:09:16.596613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 420/832] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 13:09:15 2022] POST /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:09:27.034887 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-182ea65c-5b36-4310-9b9f-e0ab7bd28453 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Action: 'create', calling method: .version_select at 0x7f9a66fbb550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2073671466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJvrewaXPGJS/ByNxQc8phbbiZCszhWi/G9NkwPyi852/41qupNFSU/vySuCwpvljceY0gL1JihclJglwKuNIxMQ2sa1a/6/brytZA/sqqCTY4daJOxLdWbckii+eqmhg=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:09:27.039397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=5 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:27.040160 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=89 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:27.057398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-182ea65c-5b36-4310-9b9f-e0ab7bd28453 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Getting quotas for project 0df8852ede3b4845b824cc9345afbb5d. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:09:27.061172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-182ea65c-5b36-4310-9b9f-e0ab7bd28453 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Getting quotas for user 66b0a0ef7ea24caaa9540786a4d28682 and project 0df8852ede3b4845b824cc9345afbb5d. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:09:27.084270 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-182ea65c-5b36-4310-9b9f-e0ab7bd28453 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053102 May 24 13:09:27.085005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 413/833] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 13:09:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:09:27.129044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:27.130492 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:27.134570 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1116371955", "imageRef": "75a5fca7-dd7c-49f2-8dc1-ccb7d4319fc2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2073671466", "networks": [{"uuid": "740dd6ad-759f-4dcf-9e80-fc578bb54c22"}]}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:09:27.184609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.network.neutron [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] validate_networks() for [('740dd6ad-759f-4dcf-9e80-fc578bb54c22', None, None, None, None, None)] {{(pid=117643) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:09:27.644829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Flavor limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:09:27.645756 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Image limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:09:27.646253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Flavor pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:09:27.646688 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Image pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:09:27.647099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:09:27.655843 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:27.656286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:27.657072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:27.657504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:27.674518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Getting quotas for project 0df8852ede3b4845b824cc9345afbb5d. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:09:27.678553 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Getting quotas for user 66b0a0ef7ea24caaa9540786a4d28682 and project 0df8852ede3b4845b824cc9345afbb5d. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:09:27.689265 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Going to run 1 instances... {{(pid=117643) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:09:27.691583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75a5fca7-dd7c-49f2-8dc1-ccb7d4319fc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:09:27.736345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b82f07f9-8324-4a7b-acb4-eb61dd942a50 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608653 May 24 13:09:27.737354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 421/834] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:09:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 13:09:27.747396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8a20c742-b578-4acd-ae7a-7f5f5a4a2c53 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:27.748266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8a20c742-b578-4acd-ae7a-7f5f5a4a2c53 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:27.799647 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8a20c742-b578-4acd-ae7a-7f5f5a4a2c53 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:27.807708 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8a20c742-b578-4acd-ae7a-7f5f5a4a2c53 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1259 microversion: 2.1 time: 0.064175 May 24 13:09:27.816705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 414/835] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:27 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:28.826507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bed4a14a-f45d-4c1b-9334-24d575a2bfc0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:28.827125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bed4a14a-f45d-4c1b-9334-24d575a2bfc0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:28.834118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bed4a14a-f45d-4c1b-9334-24d575a2bfc0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:28.834603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bed4a14a-f45d-4c1b-9334-24d575a2bfc0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:28.835362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bed4a14a-f45d-4c1b-9334-24d575a2bfc0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:28.835805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bed4a14a-f45d-4c1b-9334-24d575a2bfc0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:28.894775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bed4a14a-f45d-4c1b-9334-24d575a2bfc0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:28.902360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bed4a14a-f45d-4c1b-9334-24d575a2bfc0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080330 May 24 13:09:28.902925 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 422/836] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:28 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:29.919570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-701abc7d-ebef-41bd-b59f-ad6a5a916084 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:29.920177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-701abc7d-ebef-41bd-b59f-ad6a5a916084 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:29.927657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-701abc7d-ebef-41bd-b59f-ad6a5a916084 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:29.928110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-701abc7d-ebef-41bd-b59f-ad6a5a916084 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:29.928880 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-701abc7d-ebef-41bd-b59f-ad6a5a916084 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:29.929536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-701abc7d-ebef-41bd-b59f-ad6a5a916084 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:29.991804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-701abc7d-ebef-41bd-b59f-ad6a5a916084 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:29.999170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-701abc7d-ebef-41bd-b59f-ad6a5a916084 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.083567 May 24 13:09:29.999740 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 415/837] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:29 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:31.016139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f73efe4e-1b7a-4a81-948d-ce33b9728611 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:31.016649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f73efe4e-1b7a-4a81-948d-ce33b9728611 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:31.023745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f73efe4e-1b7a-4a81-948d-ce33b9728611 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:31.024375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f73efe4e-1b7a-4a81-948d-ce33b9728611 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:31.025315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f73efe4e-1b7a-4a81-948d-ce33b9728611 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:31.025907 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f73efe4e-1b7a-4a81-948d-ce33b9728611 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:31.088536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f73efe4e-1b7a-4a81-948d-ce33b9728611 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:31.095774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f73efe4e-1b7a-4a81-948d-ce33b9728611 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.083649 May 24 13:09:31.096317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 423/838] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:31 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:32.112943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e1df8c26-cd5b-4b1f-80bd-714179f65967 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:32.113570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e1df8c26-cd5b-4b1f-80bd-714179f65967 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:32.122367 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1df8c26-cd5b-4b1f-80bd-714179f65967 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:32.122367 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1df8c26-cd5b-4b1f-80bd-714179f65967 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:32.122693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1df8c26-cd5b-4b1f-80bd-714179f65967 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:32.123124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1df8c26-cd5b-4b1f-80bd-714179f65967 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:32.181868 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e1df8c26-cd5b-4b1f-80bd-714179f65967 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:32.189212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e1df8c26-cd5b-4b1f-80bd-714179f65967 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080657 May 24 13:09:32.189770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 416/839] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:32 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:33.205262 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3cd0373d-63fa-43ca-b889-009d63f3b0ee tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:33.205870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3cd0373d-63fa-43ca-b889-009d63f3b0ee tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:33.212290 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3cd0373d-63fa-43ca-b889-009d63f3b0ee tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:33.212735 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3cd0373d-63fa-43ca-b889-009d63f3b0ee tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:33.213488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3cd0373d-63fa-43ca-b889-009d63f3b0ee tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:33.213919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3cd0373d-63fa-43ca-b889-009d63f3b0ee tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:33.274184 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3cd0373d-63fa-43ca-b889-009d63f3b0ee tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:33.281751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3cd0373d-63fa-43ca-b889-009d63f3b0ee tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080280 May 24 13:09:33.282339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 424/840] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:33 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:34.299772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5048abbc-c8f0-4456-a124-090566323050 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:34.300501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5048abbc-c8f0-4456-a124-090566323050 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:34.306752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5048abbc-c8f0-4456-a124-090566323050 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:34.307209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5048abbc-c8f0-4456-a124-090566323050 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:34.307988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5048abbc-c8f0-4456-a124-090566323050 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:34.308426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5048abbc-c8f0-4456-a124-090566323050 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:34.370018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5048abbc-c8f0-4456-a124-090566323050 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:34.377358 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5048abbc-c8f0-4456-a124-090566323050 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.081843 May 24 13:09:34.377919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 417/841] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:34 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:35.394365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ce3a01d1-7ef3-4cbc-aeb0-1bcfa11944a1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:35.395516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ce3a01d1-7ef3-4cbc-aeb0-1bcfa11944a1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:35.402006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce3a01d1-7ef3-4cbc-aeb0-1bcfa11944a1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:35.402495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce3a01d1-7ef3-4cbc-aeb0-1bcfa11944a1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:35.403268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce3a01d1-7ef3-4cbc-aeb0-1bcfa11944a1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:35.403709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce3a01d1-7ef3-4cbc-aeb0-1bcfa11944a1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:35.462199 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ce3a01d1-7ef3-4cbc-aeb0-1bcfa11944a1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:35.469913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ce3a01d1-7ef3-4cbc-aeb0-1bcfa11944a1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.079201 May 24 13:09:35.470650 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 425/842] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:35 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:36.487509 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-82f82d37-6981-4a6a-9d69-91c578006e9f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:36.488123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-82f82d37-6981-4a6a-9d69-91c578006e9f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:36.494644 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82f82d37-6981-4a6a-9d69-91c578006e9f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:36.495094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82f82d37-6981-4a6a-9d69-91c578006e9f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:36.495865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82f82d37-6981-4a6a-9d69-91c578006e9f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:36.496298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82f82d37-6981-4a6a-9d69-91c578006e9f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:36.554968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-82f82d37-6981-4a6a-9d69-91c578006e9f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:36.562246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-82f82d37-6981-4a6a-9d69-91c578006e9f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.078823 May 24 13:09:36.562840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 418/843] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:36 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:37.579379 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a262850c-0185-43f4-8777-314b90ef98cd tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:37.580002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a262850c-0185-43f4-8777-314b90ef98cd tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:37.586554 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a262850c-0185-43f4-8777-314b90ef98cd tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:37.587007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a262850c-0185-43f4-8777-314b90ef98cd tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:37.587766 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a262850c-0185-43f4-8777-314b90ef98cd tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:37.588205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a262850c-0185-43f4-8777-314b90ef98cd tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:37.648298 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a262850c-0185-43f4-8777-314b90ef98cd tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:37.655771 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a262850c-0185-43f4-8777-314b90ef98cd tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080412 May 24 13:09:37.656339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 426/844] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:37 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:38.672976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1fe6cb3a-a02d-4ddf-bb4d-8e23067a95de tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:38.673498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1fe6cb3a-a02d-4ddf-bb4d-8e23067a95de tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:38.675941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:38.682166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fe6cb3a-a02d-4ddf-bb4d-8e23067a95de tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:38.682642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fe6cb3a-a02d-4ddf-bb4d-8e23067a95de tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:38.683402 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fe6cb3a-a02d-4ddf-bb4d-8e23067a95de tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:38.683839 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fe6cb3a-a02d-4ddf-bb4d-8e23067a95de tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:38.744968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1fe6cb3a-a02d-4ddf-bb4d-8e23067a95de tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:38.752327 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1fe6cb3a-a02d-4ddf-bb4d-8e23067a95de tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.083352 May 24 13:09:38.752885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 419/845] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:38 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:39.768996 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-74fd5c72-cc7f-460d-999c-2c0c859b22b6 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:39.769585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-74fd5c72-cc7f-460d-999c-2c0c859b22b6 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:39.771975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:39.772617 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=6 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:39.779253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-74fd5c72-cc7f-460d-999c-2c0c859b22b6 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:39.779704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-74fd5c72-cc7f-460d-999c-2c0c859b22b6 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:39.780448 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-74fd5c72-cc7f-460d-999c-2c0c859b22b6 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:39.780883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-74fd5c72-cc7f-460d-999c-2c0c859b22b6 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:39.842389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-74fd5c72-cc7f-460d-999c-2c0c859b22b6 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:39.850516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-74fd5c72-cc7f-460d-999c-2c0c859b22b6 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.085397 May 24 13:09:39.851068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 427/846] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:39 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:40.867911 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3164fdcd-0313-48be-9e9e-c8628de95eb2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:40.868529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3164fdcd-0313-48be-9e9e-c8628de95eb2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:40.875076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3164fdcd-0313-48be-9e9e-c8628de95eb2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:40.875527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3164fdcd-0313-48be-9e9e-c8628de95eb2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:40.876284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3164fdcd-0313-48be-9e9e-c8628de95eb2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:40.876717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3164fdcd-0313-48be-9e9e-c8628de95eb2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:40.935786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3164fdcd-0313-48be-9e9e-c8628de95eb2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:40.943165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3164fdcd-0313-48be-9e9e-c8628de95eb2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.079708 May 24 13:09:40.943764 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 420/847] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:40 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:41.959621 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b0c81712-4722-4b39-b163-34cebfb70b9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:41.960234 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b0c81712-4722-4b39-b163-34cebfb70b9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:41.966780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0c81712-4722-4b39-b163-34cebfb70b9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:41.967226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0c81712-4722-4b39-b163-34cebfb70b9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:41.967978 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0c81712-4722-4b39-b163-34cebfb70b9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:41.968435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0c81712-4722-4b39-b163-34cebfb70b9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:42.027283 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b0c81712-4722-4b39-b163-34cebfb70b9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:42.034590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b0c81712-4722-4b39-b163-34cebfb70b9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.078768 May 24 13:09:42.035154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 428/848] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:41 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:43.051076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4f01dd16-4b5d-4c1a-882b-48960b7fc45b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:43.051727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4f01dd16-4b5d-4c1a-882b-48960b7fc45b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:43.058958 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f01dd16-4b5d-4c1a-882b-48960b7fc45b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:43.059405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f01dd16-4b5d-4c1a-882b-48960b7fc45b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:43.060165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f01dd16-4b5d-4c1a-882b-48960b7fc45b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:43.060601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f01dd16-4b5d-4c1a-882b-48960b7fc45b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:43.121948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4f01dd16-4b5d-4c1a-882b-48960b7fc45b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:43.129351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4f01dd16-4b5d-4c1a-882b-48960b7fc45b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.082226 May 24 13:09:43.129915 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 421/849] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:43 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:44.145773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ddbe7ebe-76e5-4b0f-a134-69a35cc4ca58 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:44.146414 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ddbe7ebe-76e5-4b0f-a134-69a35cc4ca58 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:44.152909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ddbe7ebe-76e5-4b0f-a134-69a35cc4ca58 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:44.153354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ddbe7ebe-76e5-4b0f-a134-69a35cc4ca58 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:44.154111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ddbe7ebe-76e5-4b0f-a134-69a35cc4ca58 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:44.154579 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ddbe7ebe-76e5-4b0f-a134-69a35cc4ca58 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:44.213214 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ddbe7ebe-76e5-4b0f-a134-69a35cc4ca58 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:44.220571 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ddbe7ebe-76e5-4b0f-a134-69a35cc4ca58 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.078691 May 24 13:09:44.221132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 429/850] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:44 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:45.244951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a13f704a-6bdb-40d5-a6fb-c138ee61cfb4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:45.245553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a13f704a-6bdb-40d5-a6fb-c138ee61cfb4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:45.252467 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a13f704a-6bdb-40d5-a6fb-c138ee61cfb4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:45.252910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a13f704a-6bdb-40d5-a6fb-c138ee61cfb4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:45.253880 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a13f704a-6bdb-40d5-a6fb-c138ee61cfb4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:45.254358 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a13f704a-6bdb-40d5-a6fb-c138ee61cfb4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:45.320103 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a13f704a-6bdb-40d5-a6fb-c138ee61cfb4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:45.327498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a13f704a-6bdb-40d5-a6fb-c138ee61cfb4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.086469 May 24 13:09:45.328056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 422/851] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:45 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:46.344579 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5d3c42d5-810e-42e1-8a2f-b29c652bd326 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:46.345190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5d3c42d5-810e-42e1-8a2f-b29c652bd326 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:46.352209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d3c42d5-810e-42e1-8a2f-b29c652bd326 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:46.352653 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d3c42d5-810e-42e1-8a2f-b29c652bd326 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:46.353438 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d3c42d5-810e-42e1-8a2f-b29c652bd326 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:46.353873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d3c42d5-810e-42e1-8a2f-b29c652bd326 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:46.413875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5d3c42d5-810e-42e1-8a2f-b29c652bd326 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:46.421216 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5d3c42d5-810e-42e1-8a2f-b29c652bd326 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080478 May 24 13:09:46.421769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 430/852] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:46 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:47.436766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-487ab829-8f06-45d8-b627-64657d8491a5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:47.437382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-487ab829-8f06-45d8-b627-64657d8491a5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:47.444740 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-487ab829-8f06-45d8-b627-64657d8491a5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:47.445191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-487ab829-8f06-45d8-b627-64657d8491a5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:47.445953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-487ab829-8f06-45d8-b627-64657d8491a5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:47.446425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-487ab829-8f06-45d8-b627-64657d8491a5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:47.505942 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-487ab829-8f06-45d8-b627-64657d8491a5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:47.513348 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-487ab829-8f06-45d8-b627-64657d8491a5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080439 May 24 13:09:47.513915 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 423/853] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:47 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:48.528640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b8b217d9-1f88-4851-9030-298255a0d625 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:48.529260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b8b217d9-1f88-4851-9030-298255a0d625 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:48.535760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b8b217d9-1f88-4851-9030-298255a0d625 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:48.536214 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b8b217d9-1f88-4851-9030-298255a0d625 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:48.536979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b8b217d9-1f88-4851-9030-298255a0d625 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:48.537421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b8b217d9-1f88-4851-9030-298255a0d625 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:48.598341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b8b217d9-1f88-4851-9030-298255a0d625 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:48.605731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b8b217d9-1f88-4851-9030-298255a0d625 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080865 May 24 13:09:48.606308 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 431/854] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:48 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:49.622305 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-048076ea-98b2-42aa-bf7b-58c95c3d4d72 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:49.622922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-048076ea-98b2-42aa-bf7b-58c95c3d4d72 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:49.629449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-048076ea-98b2-42aa-bf7b-58c95c3d4d72 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:49.629895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-048076ea-98b2-42aa-bf7b-58c95c3d4d72 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:49.630675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-048076ea-98b2-42aa-bf7b-58c95c3d4d72 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:49.631108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-048076ea-98b2-42aa-bf7b-58c95c3d4d72 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:49.689398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-048076ea-98b2-42aa-bf7b-58c95c3d4d72 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:49.697050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-048076ea-98b2-42aa-bf7b-58c95c3d4d72 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.078425 May 24 13:09:49.697773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 424/855] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:49 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:50.713364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4aeeea11-9a10-41c2-b223-a6d1c460aae3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:50.713911 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4aeeea11-9a10-41c2-b223-a6d1c460aae3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:50.720518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4aeeea11-9a10-41c2-b223-a6d1c460aae3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:50.720970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4aeeea11-9a10-41c2-b223-a6d1c460aae3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:50.721729 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4aeeea11-9a10-41c2-b223-a6d1c460aae3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:50.722156 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4aeeea11-9a10-41c2-b223-a6d1c460aae3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:50.781053 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-4aeeea11-9a10-41c2-b223-a6d1c460aae3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:50.788869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4aeeea11-9a10-41c2-b223-a6d1c460aae3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.079398 May 24 13:09:50.789434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 432/856] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:50 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:51.805338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-037d7d2e-699e-4daa-a0f9-92197f2a48f1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:51.805957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-037d7d2e-699e-4daa-a0f9-92197f2a48f1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:51.812715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-037d7d2e-699e-4daa-a0f9-92197f2a48f1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:51.813165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-037d7d2e-699e-4daa-a0f9-92197f2a48f1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:51.813937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-037d7d2e-699e-4daa-a0f9-92197f2a48f1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:51.814402 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-037d7d2e-699e-4daa-a0f9-92197f2a48f1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:51.876600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-037d7d2e-699e-4daa-a0f9-92197f2a48f1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:51.884910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-037d7d2e-699e-4daa-a0f9-92197f2a48f1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.084006 May 24 13:09:51.885466 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 425/857] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:51 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:52.901847 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6e329aa3-f0bb-4205-9bf3-c53fe4e56d25 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:52.902492 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6e329aa3-f0bb-4205-9bf3-c53fe4e56d25 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:52.908930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e329aa3-f0bb-4205-9bf3-c53fe4e56d25 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:52.909386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e329aa3-f0bb-4205-9bf3-c53fe4e56d25 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:52.910143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e329aa3-f0bb-4205-9bf3-c53fe4e56d25 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:52.910609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e329aa3-f0bb-4205-9bf3-c53fe4e56d25 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:52.969964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6e329aa3-f0bb-4205-9bf3-c53fe4e56d25 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:52.977360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6e329aa3-f0bb-4205-9bf3-c53fe4e56d25 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.079355 May 24 13:09:52.977923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 433/858] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:52 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:53.993890 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-95c97491-065d-41e1-becc-b122d153cf87 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:53.994458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-95c97491-065d-41e1-becc-b122d153cf87 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:54.000957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95c97491-065d-41e1-becc-b122d153cf87 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:54.001396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95c97491-065d-41e1-becc-b122d153cf87 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:54.002159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95c97491-065d-41e1-becc-b122d153cf87 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:54.002620 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95c97491-065d-41e1-becc-b122d153cf87 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:54.063180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-95c97491-065d-41e1-becc-b122d153cf87 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:54.070566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-95c97491-065d-41e1-becc-b122d153cf87 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080698 May 24 13:09:54.071149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 426/859] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:53 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:55.087018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-faf0877c-4c53-4ab8-b6ec-bb731ebfb9ff tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:55.087643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-faf0877c-4c53-4ab8-b6ec-bb731ebfb9ff tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:55.094172 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-faf0877c-4c53-4ab8-b6ec-bb731ebfb9ff tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:55.094656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-faf0877c-4c53-4ab8-b6ec-bb731ebfb9ff tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:55.095420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-faf0877c-4c53-4ab8-b6ec-bb731ebfb9ff tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:55.095862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-faf0877c-4c53-4ab8-b6ec-bb731ebfb9ff tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:55.154147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-faf0877c-4c53-4ab8-b6ec-bb731ebfb9ff tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:55.161359 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-faf0877c-4c53-4ab8-b6ec-bb731ebfb9ff tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.078227 May 24 13:09:55.162435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 434/860] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:55 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:56.179404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5af081b1-ac6b-4046-bdf6-8ef242071d83 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:56.179979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5af081b1-ac6b-4046-bdf6-8ef242071d83 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:56.186598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5af081b1-ac6b-4046-bdf6-8ef242071d83 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:56.187048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5af081b1-ac6b-4046-bdf6-8ef242071d83 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:56.187800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5af081b1-ac6b-4046-bdf6-8ef242071d83 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:56.188232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5af081b1-ac6b-4046-bdf6-8ef242071d83 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:56.251427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5af081b1-ac6b-4046-bdf6-8ef242071d83 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:56.259736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5af081b1-ac6b-4046-bdf6-8ef242071d83 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.084866 May 24 13:09:56.260298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 427/861] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:56 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:57.276252 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d82e7cf1-3acd-401c-95c1-104ff23ca959 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:57.276785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d82e7cf1-3acd-401c-95c1-104ff23ca959 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:57.279124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:57.284313 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d82e7cf1-3acd-401c-95c1-104ff23ca959 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:57.284760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d82e7cf1-3acd-401c-95c1-104ff23ca959 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:57.285516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d82e7cf1-3acd-401c-95c1-104ff23ca959 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:57.285952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d82e7cf1-3acd-401c-95c1-104ff23ca959 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:57.290617 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=81 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:57.466606 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d82e7cf1-3acd-401c-95c1-104ff23ca959 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:57.474021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d82e7cf1-3acd-401c-95c1-104ff23ca959 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.202352 May 24 13:09:57.474620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 435/862] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:57 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:58.490686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ddde67b3-f9fc-4ca7-9098-7327e9800d7e tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:58.491312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ddde67b3-f9fc-4ca7-9098-7327e9800d7e tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:58.493616 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:58.499464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddde67b3-f9fc-4ca7-9098-7327e9800d7e tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:58.499917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddde67b3-f9fc-4ca7-9098-7327e9800d7e tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:58.500693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddde67b3-f9fc-4ca7-9098-7327e9800d7e tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:58.501131 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddde67b3-f9fc-4ca7-9098-7327e9800d7e tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:58.505563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=79 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:58.561659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ddde67b3-f9fc-4ca7-9098-7327e9800d7e tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:58.569257 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ddde67b3-f9fc-4ca7-9098-7327e9800d7e tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.082640 May 24 13:09:58.569828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 428/863] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:58 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:09:59.585887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0c03292a-04d1-4ced-b6f7-5ee869b0a987 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:09:59.586541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0c03292a-04d1-4ced-b6f7-5ee869b0a987 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:09:59.593083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0c03292a-04d1-4ced-b6f7-5ee869b0a987 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:59.593544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0c03292a-04d1-4ced-b6f7-5ee869b0a987 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:59.594331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0c03292a-04d1-4ced-b6f7-5ee869b0a987 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:09:59.594778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0c03292a-04d1-4ced-b6f7-5ee869b0a987 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:09:59.654818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0c03292a-04d1-4ced-b6f7-5ee869b0a987 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:09:59.662726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0c03292a-04d1-4ced-b6f7-5ee869b0a987 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080153 May 24 13:09:59.663243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 436/864] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:09:59 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:00.679561 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2a9293fe-a3ae-47c3-9eca-d95312335fb5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:00.680088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2a9293fe-a3ae-47c3-9eca-d95312335fb5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:00.688136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a9293fe-a3ae-47c3-9eca-d95312335fb5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:00.688913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a9293fe-a3ae-47c3-9eca-d95312335fb5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:00.690251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a9293fe-a3ae-47c3-9eca-d95312335fb5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:00.691050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a9293fe-a3ae-47c3-9eca-d95312335fb5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:00.811485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2a9293fe-a3ae-47c3-9eca-d95312335fb5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:00.819665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2a9293fe-a3ae-47c3-9eca-d95312335fb5 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.144527 May 24 13:10:00.820226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 429/865] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:00 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:01.836708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-936c9385-08ba-4f4b-86ae-74e56bb708c9 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:01.837336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-936c9385-08ba-4f4b-86ae-74e56bb708c9 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:01.844849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-936c9385-08ba-4f4b-86ae-74e56bb708c9 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:01.845305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-936c9385-08ba-4f4b-86ae-74e56bb708c9 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:01.846077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-936c9385-08ba-4f4b-86ae-74e56bb708c9 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:01.846554 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-936c9385-08ba-4f4b-86ae-74e56bb708c9 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:01.904772 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-936c9385-08ba-4f4b-86ae-74e56bb708c9 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:01.912152 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-936c9385-08ba-4f4b-86ae-74e56bb708c9 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.079865 May 24 13:10:01.912722 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 437/866] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:01 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:02.930257 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fe521825-f964-436d-a748-c71cde8e6bd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:02.930883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fe521825-f964-436d-a748-c71cde8e6bd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:02.937572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe521825-f964-436d-a748-c71cde8e6bd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:02.938020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe521825-f964-436d-a748-c71cde8e6bd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:02.938828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe521825-f964-436d-a748-c71cde8e6bd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:02.939251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe521825-f964-436d-a748-c71cde8e6bd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:03.007135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fe521825-f964-436d-a748-c71cde8e6bd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:03.014525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fe521825-f964-436d-a748-c71cde8e6bd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.089247 May 24 13:10:03.015082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 430/867] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:02 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:04.031665 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-49cd324f-dd44-4dba-876c-430b20639f9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:04.032209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-49cd324f-dd44-4dba-876c-430b20639f9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:04.039283 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-49cd324f-dd44-4dba-876c-430b20639f9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:04.039735 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-49cd324f-dd44-4dba-876c-430b20639f9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:04.040493 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-49cd324f-dd44-4dba-876c-430b20639f9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:04.040928 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-49cd324f-dd44-4dba-876c-430b20639f9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:04.099237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-49cd324f-dd44-4dba-876c-430b20639f9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:04.107183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-49cd324f-dd44-4dba-876c-430b20639f9b tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.079488 May 24 13:10:04.107748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 438/868] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:04 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:05.124513 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1ad720cd-c5d2-4135-9df3-31c4cbd30a30 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:05.125154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1ad720cd-c5d2-4135-9df3-31c4cbd30a30 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:05.131753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ad720cd-c5d2-4135-9df3-31c4cbd30a30 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:05.132194 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ad720cd-c5d2-4135-9df3-31c4cbd30a30 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:05.132943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ad720cd-c5d2-4135-9df3-31c4cbd30a30 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:05.133401 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ad720cd-c5d2-4135-9df3-31c4cbd30a30 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:05.193849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1ad720cd-c5d2-4135-9df3-31c4cbd30a30 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:05.201168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1ad720cd-c5d2-4135-9df3-31c4cbd30a30 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.080586 May 24 13:10:05.201720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 431/869] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:05 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:06.217660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d386bac6-53d7-44f8-9e78-48b81ff5f1fc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:06.218269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d386bac6-53d7-44f8-9e78-48b81ff5f1fc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:06.225327 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d386bac6-53d7-44f8-9e78-48b81ff5f1fc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:06.225773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d386bac6-53d7-44f8-9e78-48b81ff5f1fc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:06.226565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d386bac6-53d7-44f8-9e78-48b81ff5f1fc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:06.226998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d386bac6-53d7-44f8-9e78-48b81ff5f1fc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:06.288255 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d386bac6-53d7-44f8-9e78-48b81ff5f1fc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:06.296590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d386bac6-53d7-44f8-9e78-48b81ff5f1fc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.082641 May 24 13:10:06.297161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 439/870] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:06 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:10:07.313965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2973df24-880b-4dbe-9cd3-8c35ef47a704 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:07.314629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2973df24-880b-4dbe-9cd3-8c35ef47a704 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:07.321719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2973df24-880b-4dbe-9cd3-8c35ef47a704 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:07.322175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2973df24-880b-4dbe-9cd3-8c35ef47a704 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:07.323015 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2973df24-880b-4dbe-9cd3-8c35ef47a704 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:07.323468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2973df24-880b-4dbe-9cd3-8c35ef47a704 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:07.383461 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2973df24-880b-4dbe-9cd3-8c35ef47a704 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:07.391306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2973df24-880b-4dbe-9cd3-8c35ef47a704 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.081185 May 24 13:10:07.391809 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 432/871] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:07 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:08.407486 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1c1f9d7a-de14-45f5-8666-d99a8c5ee8ad tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:08.408105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1c1f9d7a-de14-45f5-8666-d99a8c5ee8ad tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:08.414957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c1f9d7a-de14-45f5-8666-d99a8c5ee8ad tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:08.415398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c1f9d7a-de14-45f5-8666-d99a8c5ee8ad tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:08.416175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c1f9d7a-de14-45f5-8666-d99a8c5ee8ad tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:08.416612 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c1f9d7a-de14-45f5-8666-d99a8c5ee8ad tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:08.478615 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1c1f9d7a-de14-45f5-8666-d99a8c5ee8ad tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:08.486775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1c1f9d7a-de14-45f5-8666-d99a8c5ee8ad tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.083251 May 24 13:10:08.487616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 440/872] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:08 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:09.503745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4f5d9933-5bbc-44fe-8a44-9d07afb69fd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:09.504391 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4f5d9933-5bbc-44fe-8a44-9d07afb69fd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:09.510886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f5d9933-5bbc-44fe-8a44-9d07afb69fd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:09.511337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f5d9933-5bbc-44fe-8a44-9d07afb69fd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:09.512102 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f5d9933-5bbc-44fe-8a44-9d07afb69fd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:09.512551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f5d9933-5bbc-44fe-8a44-9d07afb69fd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:09.575182 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4f5d9933-5bbc-44fe-8a44-9d07afb69fd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:09.582540 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4f5d9933-5bbc-44fe-8a44-9d07afb69fd3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.082696 May 24 13:10:09.583096 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 433/873] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:09 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:10.599174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b179f062-30b8-481f-be54-1bb271091767 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:10.599907 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b179f062-30b8-481f-be54-1bb271091767 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:10.606269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b179f062-30b8-481f-be54-1bb271091767 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:10.606749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b179f062-30b8-481f-be54-1bb271091767 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:10.607498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b179f062-30b8-481f-be54-1bb271091767 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:10.607931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b179f062-30b8-481f-be54-1bb271091767 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:10.667445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b179f062-30b8-481f-be54-1bb271091767 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:10.674783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b179f062-30b8-481f-be54-1bb271091767 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1263 microversion: 2.1 time: 0.079368 May 24 13:10:10.675342 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 441/874] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:10 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:10.925033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f808f881-ef84-47de-b5ea-6dd1baf8141f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:10.925986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f808f881-ef84-47de-b5ea-6dd1baf8141f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:10.933146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f808f881-ef84-47de-b5ea-6dd1baf8141f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:10.933590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f808f881-ef84-47de-b5ea-6dd1baf8141f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:10.934362 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f808f881-ef84-47de-b5ea-6dd1baf8141f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:10.934800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f808f881-ef84-47de-b5ea-6dd1baf8141f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:10.962386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f808f881-ef84-47de-b5ea-6dd1baf8141f tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041229 May 24 13:10:10.962918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 434/875] 10.222.0.45 () {60 vars in 1342 bytes} [Tue May 24 13:10:10 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:11.019236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7213a8f1-8e73-4bdf-a7d2-7237406edc6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:11.019960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7213a8f1-8e73-4bdf-a7d2-7237406edc6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:11.026420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7213a8f1-8e73-4bdf-a7d2-7237406edc6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:11.026886 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7213a8f1-8e73-4bdf-a7d2-7237406edc6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:11.027739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7213a8f1-8e73-4bdf-a7d2-7237406edc6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:11.028195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7213a8f1-8e73-4bdf-a7d2-7237406edc6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:11.055033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7213a8f1-8e73-4bdf-a7d2-7237406edc6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Going to try to terminate instance {{(pid=117643) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:10:11.129169 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7213a8f1-8e73-4bdf-a7d2-7237406edc6a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 204 len: 0 microversion: 2.20 time: 0.113423 May 24 13:10:11.129666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 442/876] 10.222.0.45 () {60 vars in 1279 bytes} [Tue May 24 13:10:11 2022] DELETE /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 13:10:11.137811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:11.138454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:11.144593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:11.145048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:11.145801 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:11.146232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:11.272960 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:11.280845 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:11.282391 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:11.283536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-666fffc6-fe47-45b8-8b7d-1f79db4a4a27 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.149667 May 24 13:10:11.284077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 435/877] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:11 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:11.692195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b5176495-cea3-4a87-842a-cf90d8611da3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:11.692923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b5176495-cea3-4a87-842a-cf90d8611da3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:11.699808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5176495-cea3-4a87-842a-cf90d8611da3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:11.700251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5176495-cea3-4a87-842a-cf90d8611da3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:11.701001 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5176495-cea3-4a87-842a-cf90d8611da3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:11.701432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5176495-cea3-4a87-842a-cf90d8611da3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:11.764843 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b5176495-cea3-4a87-842a-cf90d8611da3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:11.773177 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b5176495-cea3-4a87-842a-cf90d8611da3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1255 microversion: 2.1 time: 0.085074 May 24 13:10:11.773742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 443/878] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:11 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1255 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:12.301884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:12.302565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:12.310439 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:12.310888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:12.311651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:12.312083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:12.438210 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:12.446147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:12.447690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:12.448831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3f5a2930-6c9d-48d3-a92d-06f4994a5479 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.150841 May 24 13:10:12.449388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 436/879] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:12 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:12.790190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7e748da3-7dea-4fe2-9869-96b8c6a37467 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:12.790830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7e748da3-7dea-4fe2-9869-96b8c6a37467 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:12.797854 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e748da3-7dea-4fe2-9869-96b8c6a37467 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:12.798533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e748da3-7dea-4fe2-9869-96b8c6a37467 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:12.800112 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e748da3-7dea-4fe2-9869-96b8c6a37467 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:12.800624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e748da3-7dea-4fe2-9869-96b8c6a37467 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:12.864978 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7e748da3-7dea-4fe2-9869-96b8c6a37467 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:12.872346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7e748da3-7dea-4fe2-9869-96b8c6a37467 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1255 microversion: 2.1 time: 0.086720 May 24 13:10:12.872897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 444/880] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:12 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1255 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:13.466167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:13.466824 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:13.473403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:13.473851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:13.474632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:13.475097 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:13.614825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:13.623700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:13.625221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:13.626428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-67b08c48-2e8e-4d02-890a-c01f83a7a92c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1723 microversion: 2.20 time: 0.164205 May 24 13:10:13.627321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 437/881] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:13 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:13.851507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3b0e3eaf-18ce-4850-a27d-76cc7ed24e69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:13.852510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3b0e3eaf-18ce-4850-a27d-76cc7ed24e69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:13.859499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b0e3eaf-18ce-4850-a27d-76cc7ed24e69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:13.859962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b0e3eaf-18ce-4850-a27d-76cc7ed24e69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:13.860879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b0e3eaf-18ce-4850-a27d-76cc7ed24e69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:13.861322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b0e3eaf-18ce-4850-a27d-76cc7ed24e69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:13.893553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0ef30a9b-62b9-4a9a-ae92-fc58521029a7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:13.893906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3b0e3eaf-18ce-4850-a27d-76cc7ed24e69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046848 May 24 13:10:13.894454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0ef30a9b-62b9-4a9a-ae92-fc58521029a7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:13.894610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 445/882] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:10:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:10:13.901739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ef30a9b-62b9-4a9a-ae92-fc58521029a7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:13.902310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ef30a9b-62b9-4a9a-ae92-fc58521029a7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:13.903297 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ef30a9b-62b9-4a9a-ae92-fc58521029a7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:13.903797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ef30a9b-62b9-4a9a-ae92-fc58521029a7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:13.973778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0ef30a9b-62b9-4a9a-ae92-fc58521029a7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:13.983307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0ef30a9b-62b9-4a9a-ae92-fc58521029a7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1311 microversion: 2.1 time: 0.093941 May 24 13:10:13.984612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 438/883] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:13 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:10:14.043734 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-536455e3-8813-4211-b489-59d9e8cc735c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:14.044598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-536455e3-8813-4211-b489-59d9e8cc735c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:14.051704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-536455e3-8813-4211-b489-59d9e8cc735c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:14.052253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-536455e3-8813-4211-b489-59d9e8cc735c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:14.053339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-536455e3-8813-4211-b489-59d9e8cc735c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:14.054008 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-536455e3-8813-4211-b489-59d9e8cc735c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:14.103639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-536455e3-8813-4211-b489-59d9e8cc735c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments/bb299a3c-ee5e-487b-b0ef-db0d627839ef" status: 200 len: 194 microversion: 2.1 time: 0.064990 May 24 13:10:14.104915 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 446/884] 10.222.0.45 () {58 vars in 1412 bytes} [Tue May 24 13:10:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments/bb299a3c-ee5e-487b-b0ef-db0d627839ef => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:10:14.115354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1a0650eb-aa05-482c-969d-054573dd988a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:14.116981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1a0650eb-aa05-482c-969d-054573dd988a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:14.125440 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1a0650eb-aa05-482c-969d-054573dd988a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:14.125829 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1a0650eb-aa05-482c-969d-054573dd988a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:14.126826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1a0650eb-aa05-482c-969d-054573dd988a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:14.127276 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1a0650eb-aa05-482c-969d-054573dd988a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:14.246445 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-1a0650eb-aa05-482c-969d-054573dd988a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lazy-loading 'services' on Instance uuid 48e87855-d184-4691-9f6b-40e2b7d023d1 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:10:14.372797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1a0650eb-aa05-482c-969d-054573dd988a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "DELETE /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments/bb299a3c-ee5e-487b-b0ef-db0d627839ef" status: 202 len: 0 microversion: 2.1 time: 0.262104 May 24 13:10:14.373760 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 439/885] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 13:10:14 2022] DELETE /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments/bb299a3c-ee5e-487b-b0ef-db0d627839ef => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:10:14.589164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-e0209afc-5f6f-41f7-a219-3f1687888eeb req-64346136-9478-421b-b110-d42d80d95545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29462bbf-3714-42f0-893e-fb7de5ca0d2b", "name": "network-vif-deleted", "tag": "18ede545-422b-43fc-a7eb-acadacd87ad7"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:10:14.598541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-e0209afc-5f6f-41f7-a219-3f1687888eeb req-64346136-9478-421b-b110-d42d80d95545 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:14.599329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-e0209afc-5f6f-41f7-a219-3f1687888eeb req-64346136-9478-421b-b110-d42d80d95545 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:14.614720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-e0209afc-5f6f-41f7-a219-3f1687888eeb req-64346136-9478-421b-b110-d42d80d95545 service nova] Creating event network-vif-deleted:18ede545-422b-43fc-a7eb-acadacd87ad7 for instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b on hv-cinder-84301 May 24 13:10:14.621371 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-e0209afc-5f6f-41f7-a219-3f1687888eeb req-64346136-9478-421b-b110-d42d80d95545 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036238 May 24 13:10:14.622330 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 447/886] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:10:14.646051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:14.646984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:14.654157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:14.654655 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:14.655437 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:14.655881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:14.764852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:14.774246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:14.775766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:14.776919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-987db8d3-9c85-40a1-809e-f550ced41d0c tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.135598 May 24 13:10:14.778185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 440/887] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:14 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:15.003241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e4aa48fa-07e6-426d-9b30-39d5dfc1b479 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:15.003967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e4aa48fa-07e6-426d-9b30-39d5dfc1b479 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:15.019983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e4aa48fa-07e6-426d-9b30-39d5dfc1b479 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:15.020464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e4aa48fa-07e6-426d-9b30-39d5dfc1b479 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:15.021259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e4aa48fa-07e6-426d-9b30-39d5dfc1b479 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:15.022255 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e4aa48fa-07e6-426d-9b30-39d5dfc1b479 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:15.314980 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e4aa48fa-07e6-426d-9b30-39d5dfc1b479 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:15.337110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e4aa48fa-07e6-426d-9b30-39d5dfc1b479 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.339655 May 24 13:10:15.337705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 448/888] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:14 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:15.795864 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:15.796652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:15.804248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:15.804958 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:15.805936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:15.806422 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:15.907098 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:15.915704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:15.917462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:15.918883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e5403499-b2c8-459d-9e98-ba9d215657d7 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.127303 May 24 13:10:15.919445 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 441/889] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:15 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:16.355056 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0d164196-f409-489f-bde9-7a0b2837cede tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:16.356371 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0d164196-f409-489f-bde9-7a0b2837cede tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:16.363574 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d164196-f409-489f-bde9-7a0b2837cede tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:16.364029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d164196-f409-489f-bde9-7a0b2837cede tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:16.364812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d164196-f409-489f-bde9-7a0b2837cede tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:16.365259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d164196-f409-489f-bde9-7a0b2837cede tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:16.503359 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0d164196-f409-489f-bde9-7a0b2837cede tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:16.511711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0d164196-f409-489f-bde9-7a0b2837cede tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.160433 May 24 13:10:16.512282 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 449/890] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:16 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:16.937046 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:16.937736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:16.945319 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:16.945777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:16.946590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:16.947033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:17.010238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:17.018566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:17.020077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:17.021247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f29c0522-43dc-49fc-8f65-298976b08177 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.088231 May 24 13:10:17.022463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 442/891] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:16 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:17.531742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-401fa60b-0773-4f42-8b77-40ea772d1b9d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:17.531742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-401fa60b-0773-4f42-8b77-40ea772d1b9d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:17.535922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-401fa60b-0773-4f42-8b77-40ea772d1b9d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:17.536382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-401fa60b-0773-4f42-8b77-40ea772d1b9d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:17.537168 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-401fa60b-0773-4f42-8b77-40ea772d1b9d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:17.538158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-401fa60b-0773-4f42-8b77-40ea772d1b9d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:17.670703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-401fa60b-0773-4f42-8b77-40ea772d1b9d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:17.673006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:17.682069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-401fa60b-0773-4f42-8b77-40ea772d1b9d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.157546 May 24 13:10:17.682752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 450/892] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:17 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:18.042756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:18.043316 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:18.050126 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:18.050604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:18.051382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:18.051816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:18.115451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:18.124682 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:18.126435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:18.127660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5f557921-f67a-47a0-baef-c4a57f511333 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.088919 May 24 13:10:18.128225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 443/893] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:18 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:18.699208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a7ec053b-24e8-432c-a693-e4696dc0a772 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:18.699832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a7ec053b-24e8-432c-a693-e4696dc0a772 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:18.707811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a7ec053b-24e8-432c-a693-e4696dc0a772 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:18.708303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a7ec053b-24e8-432c-a693-e4696dc0a772 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:18.709237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a7ec053b-24e8-432c-a693-e4696dc0a772 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:18.709800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a7ec053b-24e8-432c-a693-e4696dc0a772 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:18.845171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a7ec053b-24e8-432c-a693-e4696dc0a772 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:18.853024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a7ec053b-24e8-432c-a693-e4696dc0a772 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.157555 May 24 13:10:18.853945 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 451/894] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:18 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:19.145448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:19.146050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:19.152918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:19.153377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:19.154166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:19.154630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:19.157612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:19.219461 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:19.228255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:19.229743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:19.230910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a34f8ba-6f71-4d51-a9d8-36d5c7a3c62b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.089404 May 24 13:10:19.231472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 444/895] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:19 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:19.871077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-081533c5-e645-4578-84d0-8b00d794dbf1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:19.871929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-081533c5-e645-4578-84d0-8b00d794dbf1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:19.878847 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-081533c5-e645-4578-84d0-8b00d794dbf1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:19.879302 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-081533c5-e645-4578-84d0-8b00d794dbf1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:19.880081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-081533c5-e645-4578-84d0-8b00d794dbf1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:19.880521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-081533c5-e645-4578-84d0-8b00d794dbf1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:20.012805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-081533c5-e645-4578-84d0-8b00d794dbf1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:20.020735 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-081533c5-e645-4578-84d0-8b00d794dbf1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.153490 May 24 13:10:20.021317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 452/896] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:19 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:20.251488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:20.252099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:20.259242 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:20.259687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:20.260484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:20.260871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:20.329848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:20.337771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:20.339289 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:20.340426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7048dbf2-33b9-4215-b0e5-83da7a1f189e tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.092845 May 24 13:10:20.340972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 445/897] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:20 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:21.038943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-94eb4913-77d2-4286-9273-92b4b8addedc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:21.039619 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-94eb4913-77d2-4286-9273-92b4b8addedc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:21.046266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94eb4913-77d2-4286-9273-92b4b8addedc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:21.046751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94eb4913-77d2-4286-9273-92b4b8addedc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:21.047519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94eb4913-77d2-4286-9273-92b4b8addedc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:21.048427 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94eb4913-77d2-4286-9273-92b4b8addedc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:21.190484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-94eb4913-77d2-4286-9273-92b4b8addedc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:21.198887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-94eb4913-77d2-4286-9273-92b4b8addedc tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.164534 May 24 13:10:21.199466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 453/898] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:21 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:10:21.360218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:21.360835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:21.367941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:21.368384 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:21.369146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:21.369579 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:21.436963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:21.446229 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:21.447896 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:21.449061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1bb86fdc-6b4c-4adf-a81c-f89a70a6a326 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.094188 May 24 13:10:21.449617 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 446/899] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:21 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:22.216180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bc6befe3-5027-4867-acea-d77c47da2a11 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:22.216823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bc6befe3-5027-4867-acea-d77c47da2a11 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:22.223476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc6befe3-5027-4867-acea-d77c47da2a11 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:22.224011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc6befe3-5027-4867-acea-d77c47da2a11 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:22.224875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc6befe3-5027-4867-acea-d77c47da2a11 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:22.225386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc6befe3-5027-4867-acea-d77c47da2a11 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:22.357727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bc6befe3-5027-4867-acea-d77c47da2a11 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:22.365630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bc6befe3-5027-4867-acea-d77c47da2a11 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.153357 May 24 13:10:22.366207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 454/900] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:22 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:22.467626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:22.468149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:22.474587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:22.475033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:22.475867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:22.476298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:22.538322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:22.546214 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:22.547748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:22.548892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9060ea65-b837-4eb2-864b-438f62da285b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.085226 May 24 13:10:22.549450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 447/901] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:22 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:23.383370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-454a6fa2-06ba-4403-85f6-e62a531a1700 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:23.384003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-454a6fa2-06ba-4403-85f6-e62a531a1700 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:23.390951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-454a6fa2-06ba-4403-85f6-e62a531a1700 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:23.391430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-454a6fa2-06ba-4403-85f6-e62a531a1700 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:23.392207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-454a6fa2-06ba-4403-85f6-e62a531a1700 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:23.392648 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-454a6fa2-06ba-4403-85f6-e62a531a1700 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:23.524968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-454a6fa2-06ba-4403-85f6-e62a531a1700 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:23.532790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-454a6fa2-06ba-4403-85f6-e62a531a1700 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.153611 May 24 13:10:23.533897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 455/902] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:23 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:23.568227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:23.568843 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:23.575963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:23.576860 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:23.578029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:23.578713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:23.661013 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:23.679705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:23.681240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:23.682481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1b90d012-05fe-44d5-a2a4-9bfc8232b941 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.119134 May 24 13:10:23.683038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 448/903] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:23 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:24.550243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b996b5ed-e75b-424b-babc-bf57f644c622 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:24.550807 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b996b5ed-e75b-424b-babc-bf57f644c622 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:24.558373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b996b5ed-e75b-424b-babc-bf57f644c622 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:24.558831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b996b5ed-e75b-424b-babc-bf57f644c622 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:24.559610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b996b5ed-e75b-424b-babc-bf57f644c622 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:24.560052 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b996b5ed-e75b-424b-babc-bf57f644c622 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:24.699078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b996b5ed-e75b-424b-babc-bf57f644c622 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:24.701581 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:24.702182 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:24.706624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b996b5ed-e75b-424b-babc-bf57f644c622 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.160370 May 24 13:10:24.707267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 456/904] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:24 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:24.708667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:24.709129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:24.709896 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:24.710360 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:24.789657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:24.799271 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:24.800889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:24.802041 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1d63da38-2579-4bdf-ae44-3995258c2879 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.104300 May 24 13:10:24.802874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 449/905] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:24 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:10:25.724458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b489cc8b-1daa-4e94-9723-b31598cf153f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:25.725086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b489cc8b-1daa-4e94-9723-b31598cf153f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:25.732999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b489cc8b-1daa-4e94-9723-b31598cf153f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:25.733443 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b489cc8b-1daa-4e94-9723-b31598cf153f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:25.734492 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b489cc8b-1daa-4e94-9723-b31598cf153f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:25.735107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b489cc8b-1daa-4e94-9723-b31598cf153f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:25.819701 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:25.820885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:25.827907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:25.828491 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:25.829385 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:25.829877 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:25.868420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b489cc8b-1daa-4e94-9723-b31598cf153f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:25.876207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b489cc8b-1daa-4e94-9723-b31598cf153f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.155528 May 24 13:10:25.876785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 457/906] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:25 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:25.892949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:25.901744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:25.903264 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:25.904405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ccbfeecd-0d75-43b9-8a0c-85d26903b947 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.088662 May 24 13:10:25.904956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 450/907] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:25 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:10:26.892820 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d2d5e087-2b7e-4e7b-a48d-4436307beee1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:26.893430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d2d5e087-2b7e-4e7b-a48d-4436307beee1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:26.900526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d2d5e087-2b7e-4e7b-a48d-4436307beee1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:26.900999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d2d5e087-2b7e-4e7b-a48d-4436307beee1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:26.901752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d2d5e087-2b7e-4e7b-a48d-4436307beee1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:26.902182 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d2d5e087-2b7e-4e7b-a48d-4436307beee1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:26.921607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:26.922224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:26.928704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:26.929174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:26.930008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:26.930489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:26.993769 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:27.001903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:27.003446 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:27.004606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4e4d32b5-04b6-4a41-bd85-451eb125ed1b tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.086882 May 24 13:10:27.005359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 451/908] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:26 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:10:27.035859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d2d5e087-2b7e-4e7b-a48d-4436307beee1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:27.043892 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d2d5e087-2b7e-4e7b-a48d-4436307beee1 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.154917 May 24 13:10:27.044455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 458/909] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:26 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:28.022936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:28.023508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:28.030052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:28.030533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:28.031288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:28.031723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:28.060888 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6d0a59ff-d27e-42c9-9513-0beb6560f7e4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:28.061535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6d0a59ff-d27e-42c9-9513-0beb6560f7e4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:28.063839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:28.069259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d0a59ff-d27e-42c9-9513-0beb6560f7e4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:28.069709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d0a59ff-d27e-42c9-9513-0beb6560f7e4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:28.070515 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d0a59ff-d27e-42c9-9513-0beb6560f7e4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:28.070954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6d0a59ff-d27e-42c9-9513-0beb6560f7e4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:28.095522 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:28.104046 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:28.105543 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:28.106746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eed98d9b-b8f9-438f-8318-f9d693d49981 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1655 microversion: 2.20 time: 0.087736 May 24 13:10:28.107459 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 452/910] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:28 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:28.198415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6d0a59ff-d27e-42c9-9513-0beb6560f7e4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:28.205777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6d0a59ff-d27e-42c9-9513-0beb6560f7e4 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.148655 May 24 13:10:28.206365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 459/911] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:28 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:10:29.124967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:29.125577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:29.127902 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=50 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:29.134018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:29.134569 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:29.135331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:29.135791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:29.223245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dc04c087-74fc-41d6-a89f-b3c9d122047f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:29.223870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dc04c087-74fc-41d6-a89f-b3c9d122047f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:29.230100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:29.230921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc04c087-74fc-41d6-a89f-b3c9d122047f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:29.231374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc04c087-74fc-41d6-a89f-b3c9d122047f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:29.232552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc04c087-74fc-41d6-a89f-b3c9d122047f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:29.233162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc04c087-74fc-41d6-a89f-b3c9d122047f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:29.240772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:29.243298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b0dfb3d6514817aba4ab34fd972ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57720cd453848a89315ad87ace38161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:29.244682 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-300b881d-2ab1-4f0b-b3c0-d4d5929fa4d4 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 200 len: 1366 microversion: 2.20 time: 0.123650 May 24 13:10:29.256085 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 453/912] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:29 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:10:29.368093 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dc04c087-74fc-41d6-a89f-b3c9d122047f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:29.375664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dc04c087-74fc-41d6-a89f-b3c9d122047f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.157086 May 24 13:10:29.376245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 460/913] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:29 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:10:29.855095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-9f0b32c1-713c-44b8-95c4-57047209ad7c req-714566a2-a52a-4a76-920b-4b1e297e5af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db06208c-44a3-4b4b-99af-df2d5c97378d", "tag": "f36dcd31-adf8-4ac3-8188-5f3c4d6197f3"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:10:29.865526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9f0b32c1-713c-44b8-95c4-57047209ad7c req-714566a2-a52a-4a76-920b-4b1e297e5af8 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:29.866529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9f0b32c1-713c-44b8-95c4-57047209ad7c req-714566a2-a52a-4a76-920b-4b1e297e5af8 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:29.879296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-9f0b32c1-713c-44b8-95c4-57047209ad7c req-714566a2-a52a-4a76-920b-4b1e297e5af8 service nova] Creating event network-changed:f36dcd31-adf8-4ac3-8188-5f3c4d6197f3 for instance db06208c-44a3-4b4b-99af-df2d5c97378d on hv-cinder-84301 May 24 13:10:29.885216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-9f0b32c1-713c-44b8-95c4-57047209ad7c req-714566a2-a52a-4a76-920b-4b1e297e5af8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056038 May 24 13:10:29.886073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 454/914] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:10:30.263374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:30.263995 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:30.270562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:30.271260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:30.272189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:30.272799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:30.288964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] HTTP exception thrown: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Request method failure captured: May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b HTTP/1.1 May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbZoQy-eR6FHCFODsrK1xBISdBLWpwyMp6dg7yRQRwGroYtc1-dSGvt5AdTvnp7FEoW1Xyxx5-Kmg0aHlgoIWJlk6ZbcODSL2sqXnQ3_jkyBEaHJuGuLt1dIeCk1FofyWKyjZaTfkIP8sZB7SHcX8royL2ZXZTfs_libM9gJbh_Izg May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Openstack-Nova-Api-Version: 2.20 May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: e57720cd453848a89315ad87ace38161 May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:10:30.291436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e57720cd453848a89315ad87ace38161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e57720cd453848a89315ad87ace38161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: e57720cd453848a89315ad87ace38161 May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: f7b0dfb3d6514817aba4ab34fd972ba1 May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:10:30.293181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '29462bbf-3714-42f0-893e-fb7de5ca0d2b'} May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:10:30.294227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:10:30.297737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:10:30.298950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Returning 404 to user: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:10:30.298950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6dc2286e-0aee-480f-883b-4e1a097a727a tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 404 len: 111 microversion: 2.20 time: 0.035157 May 24 13:10:30.298950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 461/915] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:10:30 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 13:10:30.304794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d09b467-9b03-485e-82c5-cebbcfc517d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '.version_select at 0x7f9a66eae280>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:30.331830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d09b467-9b03-485e-82c5-cebbcfc517d0 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626728203" status: 204 len: 0 microversion: 2.20 time: 0.031667 May 24 13:10:30.332420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 455/916] 10.222.0.45 () {60 vars in 1258 bytes} [Tue May 24 13:10:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626728203 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 13:10:30.393076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3ecddf26-40a8-40e9-9eb1-69eacd6b027d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:30.394135 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3ecddf26-40a8-40e9-9eb1-69eacd6b027d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:30.401556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ecddf26-40a8-40e9-9eb1-69eacd6b027d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:30.402276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ecddf26-40a8-40e9-9eb1-69eacd6b027d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:30.403827 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ecddf26-40a8-40e9-9eb1-69eacd6b027d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:30.404398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ecddf26-40a8-40e9-9eb1-69eacd6b027d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:30.541987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3ecddf26-40a8-40e9-9eb1-69eacd6b027d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:30.549586 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3ecddf26-40a8-40e9-9eb1-69eacd6b027d tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.160427 May 24 13:10:30.550161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 462/917] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:30 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:31.567539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a35ad51c-34fb-42af-9ff0-11a701b0f4ea tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:31.568307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a35ad51c-34fb-42af-9ff0-11a701b0f4ea tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:31.575132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a35ad51c-34fb-42af-9ff0-11a701b0f4ea tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:31.575587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a35ad51c-34fb-42af-9ff0-11a701b0f4ea tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:31.576354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a35ad51c-34fb-42af-9ff0-11a701b0f4ea tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:31.576791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a35ad51c-34fb-42af-9ff0-11a701b0f4ea tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:31.702712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a35ad51c-34fb-42af-9ff0-11a701b0f4ea tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:31.710053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a35ad51c-34fb-42af-9ff0-11a701b0f4ea tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.147110 May 24 13:10:31.711244 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 456/918] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:31 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:32.727277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-04e2f2d5-9a05-4afb-9a8d-d7c6524d714f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:32.727895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-04e2f2d5-9a05-4afb-9a8d-d7c6524d714f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:32.734499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04e2f2d5-9a05-4afb-9a8d-d7c6524d714f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:32.734956 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04e2f2d5-9a05-4afb-9a8d-d7c6524d714f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:32.735718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04e2f2d5-9a05-4afb-9a8d-d7c6524d714f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:32.736156 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04e2f2d5-9a05-4afb-9a8d-d7c6524d714f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:32.867749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-04e2f2d5-9a05-4afb-9a8d-d7c6524d714f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:32.875319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-04e2f2d5-9a05-4afb-9a8d-d7c6524d714f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.151874 May 24 13:10:32.875881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 463/919] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:32 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:33.892889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0c203725-d82b-4dd9-b38f-7b46e59478f3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:33.893512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0c203725-d82b-4dd9-b38f-7b46e59478f3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:33.900499 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c203725-d82b-4dd9-b38f-7b46e59478f3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:33.900951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c203725-d82b-4dd9-b38f-7b46e59478f3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:33.901721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c203725-d82b-4dd9-b38f-7b46e59478f3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:33.902168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c203725-d82b-4dd9-b38f-7b46e59478f3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:34.028823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0c203725-d82b-4dd9-b38f-7b46e59478f3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:34.036233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0c203725-d82b-4dd9-b38f-7b46e59478f3 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.147285 May 24 13:10:34.036797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 457/920] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:33 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:35.052632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8f67be0e-6450-4342-a00b-84f6613bc060 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:35.053244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8f67be0e-6450-4342-a00b-84f6613bc060 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:35.059818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f67be0e-6450-4342-a00b-84f6613bc060 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:35.060269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f67be0e-6450-4342-a00b-84f6613bc060 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:35.061029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f67be0e-6450-4342-a00b-84f6613bc060 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:35.061467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f67be0e-6450-4342-a00b-84f6613bc060 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:35.185337 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8f67be0e-6450-4342-a00b-84f6613bc060 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:35.192717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8f67be0e-6450-4342-a00b-84f6613bc060 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.143853 May 24 13:10:35.193274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 464/921] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:35 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:36.209293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-57934626-7de7-4e43-880a-7888a43d290f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:36.209863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-57934626-7de7-4e43-880a-7888a43d290f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:36.216474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57934626-7de7-4e43-880a-7888a43d290f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:36.216919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57934626-7de7-4e43-880a-7888a43d290f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:36.217677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57934626-7de7-4e43-880a-7888a43d290f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:36.218112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57934626-7de7-4e43-880a-7888a43d290f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:36.342376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57934626-7de7-4e43-880a-7888a43d290f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:36.349773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-57934626-7de7-4e43-880a-7888a43d290f tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.144468 May 24 13:10:36.350709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 458/922] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:36 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:37.367713 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3f5b3722-63c5-43a9-aebc-14011748cfb7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:37.368331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3f5b3722-63c5-43a9-aebc-14011748cfb7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:37.374964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3f5b3722-63c5-43a9-aebc-14011748cfb7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:37.375457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3f5b3722-63c5-43a9-aebc-14011748cfb7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:37.376262 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3f5b3722-63c5-43a9-aebc-14011748cfb7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:37.376816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3f5b3722-63c5-43a9-aebc-14011748cfb7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:37.502952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3f5b3722-63c5-43a9-aebc-14011748cfb7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:37.511068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3f5b3722-63c5-43a9-aebc-14011748cfb7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.147812 May 24 13:10:37.512237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 465/923] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:37 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:37.841778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-53fea8a0-b422-46ac-b0a4-b82e7cc2fe0e req-c5b6a377-a9ed-4d24-913d-2b1b1008fea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db06208c-44a3-4b4b-99af-df2d5c97378d", "name": "network-vif-plugged", "status": "completed", "tag": "f36dcd31-adf8-4ac3-8188-5f3c4d6197f3"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:10:37.851005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-53fea8a0-b422-46ac-b0a4-b82e7cc2fe0e req-c5b6a377-a9ed-4d24-913d-2b1b1008fea2 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:37.852020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-53fea8a0-b422-46ac-b0a4-b82e7cc2fe0e req-c5b6a377-a9ed-4d24-913d-2b1b1008fea2 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:37.864030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-53fea8a0-b422-46ac-b0a4-b82e7cc2fe0e req-c5b6a377-a9ed-4d24-913d-2b1b1008fea2 service nova] Creating event network-vif-plugged:f36dcd31-adf8-4ac3-8188-5f3c4d6197f3 for instance db06208c-44a3-4b4b-99af-df2d5c97378d on hv-cinder-84301 May 24 13:10:37.869761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-53fea8a0-b422-46ac-b0a4-b82e7cc2fe0e req-c5b6a377-a9ed-4d24-913d-2b1b1008fea2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031692 May 24 13:10:37.870601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 459/924] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:10:38.528037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3b1dfc16-ff9b-4bae-8517-c790ab12b362 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:38.529432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3b1dfc16-ff9b-4bae-8517-c790ab12b362 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:38.535916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b1dfc16-ff9b-4bae-8517-c790ab12b362 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:38.536362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b1dfc16-ff9b-4bae-8517-c790ab12b362 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:38.537124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b1dfc16-ff9b-4bae-8517-c790ab12b362 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:38.537557 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b1dfc16-ff9b-4bae-8517-c790ab12b362 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:38.663634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3b1dfc16-ff9b-4bae-8517-c790ab12b362 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:38.671896 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3b1dfc16-ff9b-4bae-8517-c790ab12b362 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.147646 May 24 13:10:38.672461 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 466/925] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:38 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:39.689665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b9ba2518-5786-4efd-9628-28cd067e975a tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:39.690385 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b9ba2518-5786-4efd-9628-28cd067e975a tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:39.696598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b9ba2518-5786-4efd-9628-28cd067e975a tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:39.697050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b9ba2518-5786-4efd-9628-28cd067e975a tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:39.697811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b9ba2518-5786-4efd-9628-28cd067e975a tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:39.698247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b9ba2518-5786-4efd-9628-28cd067e975a tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:39.835294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b9ba2518-5786-4efd-9628-28cd067e975a tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:39.842753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b9ba2518-5786-4efd-9628-28cd067e975a tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1359 microversion: 2.1 time: 0.157748 May 24 13:10:39.844291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 460/926] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:39 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:40.859674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-eb4b362b-60b1-48ef-a879-f98a834cce88 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:40.860291 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-eb4b362b-60b1-48ef-a879-f98a834cce88 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:40.867014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb4b362b-60b1-48ef-a879-f98a834cce88 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:40.867465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb4b362b-60b1-48ef-a879-f98a834cce88 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:40.868232 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb4b362b-60b1-48ef-a879-f98a834cce88 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:40.868667 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb4b362b-60b1-48ef-a879-f98a834cce88 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:40.993053 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-eb4b362b-60b1-48ef-a879-f98a834cce88 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:41.000505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-eb4b362b-60b1-48ef-a879-f98a834cce88 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1549 microversion: 2.1 time: 0.144694 May 24 13:10:41.001067 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 467/927] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:40 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:41.016547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5e9ec2b8-d173-4019-909c-4b5505c029e2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:41.017166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5e9ec2b8-d173-4019-909c-4b5505c029e2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:41.023651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e9ec2b8-d173-4019-909c-4b5505c029e2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:41.024706 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e9ec2b8-d173-4019-909c-4b5505c029e2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:41.025674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e9ec2b8-d173-4019-909c-4b5505c029e2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:41.026112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e9ec2b8-d173-4019-909c-4b5505c029e2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:41.160002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5e9ec2b8-d173-4019-909c-4b5505c029e2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:41.167435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5e9ec2b8-d173-4019-909c-4b5505c029e2 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1549 microversion: 2.1 time: 0.154732 May 24 13:10:41.168004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 461/928] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:41 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:10:41.182674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-eb796497-5b21-4f3e-adf7-43d5d24dafae tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:41.186072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-eb796497-5b21-4f3e-adf7-43d5d24dafae tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:41.186881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-eb796497-5b21-4f3e-adf7-43d5d24dafae tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Searching by: {'deleted': False, 'project_id': '0df8852ede3b4845b824cc9345afbb5d'} {{(pid=117643) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 24 13:10:41.193387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb796497-5b21-4f3e-adf7-43d5d24dafae tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:41.193835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb796497-5b21-4f3e-adf7-43d5d24dafae tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:41.194663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb796497-5b21-4f3e-adf7-43d5d24dafae tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:41.195100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb796497-5b21-4f3e-adf7-43d5d24dafae tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:41.264395 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:41.284678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.multi_cell_list [None req-eb796497-5b21-4f3e-adf7-43d5d24dafae tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 24 13:10:41.374705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-eb796497-5b21-4f3e-adf7-43d5d24dafae tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.195702 May 24 13:10:41.375280 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 468/929] 10.222.0.45 () {58 vars in 1124 bytes} [Tue May 24 13:10:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:10:41.385796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-027ab194-3c09-447c-a5ce-a8685cf9ea97 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:10:41.386537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-027ab194-3c09-447c-a5ce-a8685cf9ea97 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:10:41.392569 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-027ab194-3c09-447c-a5ce-a8685cf9ea97 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:41.393000 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-027ab194-3c09-447c-a5ce-a8685cf9ea97 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:41.393751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-027ab194-3c09-447c-a5ce-a8685cf9ea97 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:10:41.394184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-027ab194-3c09-447c-a5ce-a8685cf9ea97 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:10:41.520710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-027ab194-3c09-447c-a5ce-a8685cf9ea97 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:10:41.528090 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-027ab194-3c09-447c-a5ce-a8685cf9ea97 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1549 microversion: 2.1 time: 0.146657 May 24 13:10:41.528641 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 462/930] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:10:41 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:11:40.893808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:11:40.894627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:11:59.970089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:11:59.970644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:11:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:13:20.665514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:13:20.666127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:13:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:13:30.256109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:13:30.256637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:13:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:15:00.902574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:15:00.903173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:15:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:15:19.979110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:15:19.979701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:15:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:15:23.680470 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:15:23.681139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:15:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:15:47.784273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:15:47.784971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:15:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:16:15.038147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1edc446e-99a8-47f5-83a1-692a07eca1d0] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 13:16:15.038962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=19 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:16:15.039666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:16:15.040405 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=7 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:16:15.045762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cbaadd3b-8fd7-4ed1-af6d-2b6d4fa49213 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:15.046271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cbaadd3b-8fd7-4ed1-af6d-2b6d4fa49213 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:15.054839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cbaadd3b-8fd7-4ed1-af6d-2b6d4fa49213 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:15.055221 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cbaadd3b-8fd7-4ed1-af6d-2b6d4fa49213 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:15.055991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cbaadd3b-8fd7-4ed1-af6d-2b6d4fa49213 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:15.056434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cbaadd3b-8fd7-4ed1-af6d-2b6d4fa49213 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:15.194512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-cbaadd3b-8fd7-4ed1-af6d-2b6d4fa49213 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lazy-loading 'services' on Instance uuid 48e87855-d184-4691-9f6b-40e2b7d023d1 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:16:15.266262 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cbaadd3b-8fd7-4ed1-af6d-2b6d4fa49213 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "DELETE /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments/ce1a3b45-06f5-40d2-aaa9-fa923b8bd334" status: 202 len: 0 microversion: 2.1 time: 0.229724 May 24 13:16:15.266896 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 469/931] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 13:16:15 2022] DELETE /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments/ce1a3b45-06f5-40d2-aaa9-fa923b8bd334 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:16:15.273471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41c46349-b9d7-4e27-abfc-1423f374e67f] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 13:16:15.274059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:16:15.275017 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=99 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:16:15.279240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e72659d9-0cfe-48c1-9c53-ac20f581a5bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:15.280171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e72659d9-0cfe-48c1-9c53-ac20f581a5bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:15.289073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e72659d9-0cfe-48c1-9c53-ac20f581a5bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:15.289525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e72659d9-0cfe-48c1-9c53-ac20f581a5bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:15.290319 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e72659d9-0cfe-48c1-9c53-ac20f581a5bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:15.290763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e72659d9-0cfe-48c1-9c53-ac20f581a5bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:15.321117 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e72659d9-0cfe-48c1-9c53-ac20f581a5bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049659 May 24 13:16:15.321700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 463/932] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:16.334205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c314ba65-9abd-4839-98d8-1f703a6b5348 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:16.335237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c314ba65-9abd-4839-98d8-1f703a6b5348 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:16.343695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c314ba65-9abd-4839-98d8-1f703a6b5348 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:16.344141 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c314ba65-9abd-4839-98d8-1f703a6b5348 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:16.344891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c314ba65-9abd-4839-98d8-1f703a6b5348 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:16.345324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c314ba65-9abd-4839-98d8-1f703a6b5348 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:16.348544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] [1edc446e-99a8-47f5-83a1-692a07eca1d0] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 36878. May 24 13:16:16.379522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c314ba65-9abd-4839-98d8-1f703a6b5348 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050284 May 24 13:16:16.380078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 470/933] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:17.391136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3da0efe4-6b51-437e-a4dc-951251e315fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:17.392054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3da0efe4-6b51-437e-a4dc-951251e315fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:17.399217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3da0efe4-6b51-437e-a4dc-951251e315fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:17.399663 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3da0efe4-6b51-437e-a4dc-951251e315fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:17.400417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3da0efe4-6b51-437e-a4dc-951251e315fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:17.400851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3da0efe4-6b51-437e-a4dc-951251e315fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:17.418423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] [41c46349-b9d7-4e27-abfc-1423f374e67f] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 36888. May 24 13:16:17.431895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3da0efe4-6b51-437e-a4dc-951251e315fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044785 May 24 13:16:17.432471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 464/934] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:18.444860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-20c5e89e-08b7-4259-b857-85b0431fc1b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:18.445811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-20c5e89e-08b7-4259-b857-85b0431fc1b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:18.454532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-20c5e89e-08b7-4259-b857-85b0431fc1b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:18.455186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-20c5e89e-08b7-4259-b857-85b0431fc1b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:18.458707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-20c5e89e-08b7-4259-b857-85b0431fc1b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:18.459154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-20c5e89e-08b7-4259-b857-85b0431fc1b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:18.646894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-20c5e89e-08b7-4259-b857-85b0431fc1b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.206667 May 24 13:16:18.647429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 471/935] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:19.658580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e49fccab-2d4c-4ad2-9e4a-4a0d16b61a2f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:19.659514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e49fccab-2d4c-4ad2-9e4a-4a0d16b61a2f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:19.665999 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e49fccab-2d4c-4ad2-9e4a-4a0d16b61a2f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:19.666493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e49fccab-2d4c-4ad2-9e4a-4a0d16b61a2f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:19.667261 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e49fccab-2d4c-4ad2-9e4a-4a0d16b61a2f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:19.667703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e49fccab-2d4c-4ad2-9e4a-4a0d16b61a2f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:19.697542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e49fccab-2d4c-4ad2-9e4a-4a0d16b61a2f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043004 May 24 13:16:19.698092 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 465/936] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:20.708918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dc1ba129-1204-4943-af5a-5921c3b8d0ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:20.709830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dc1ba129-1204-4943-af5a-5921c3b8d0ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:20.716840 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc1ba129-1204-4943-af5a-5921c3b8d0ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:20.717284 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc1ba129-1204-4943-af5a-5921c3b8d0ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:20.718030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc1ba129-1204-4943-af5a-5921c3b8d0ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:20.718500 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dc1ba129-1204-4943-af5a-5921c3b8d0ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:20.747804 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dc1ba129-1204-4943-af5a-5921c3b8d0ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042791 May 24 13:16:20.748328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 472/937] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:21.759215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ba2a39b8-6ac7-41e1-bc67-1a816dd45f52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:21.760134 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ba2a39b8-6ac7-41e1-bc67-1a816dd45f52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:21.767154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba2a39b8-6ac7-41e1-bc67-1a816dd45f52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:21.767600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba2a39b8-6ac7-41e1-bc67-1a816dd45f52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:21.768355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba2a39b8-6ac7-41e1-bc67-1a816dd45f52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:21.768788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba2a39b8-6ac7-41e1-bc67-1a816dd45f52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:21.798345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ba2a39b8-6ac7-41e1-bc67-1a816dd45f52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043075 May 24 13:16:21.798891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 466/938] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:22.810523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-33b080a1-49a5-4051-bc38-699362e67295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:22.824057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-33b080a1-49a5-4051-bc38-699362e67295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:22.824057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33b080a1-49a5-4051-bc38-699362e67295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:22.824057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33b080a1-49a5-4051-bc38-699362e67295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:22.824057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33b080a1-49a5-4051-bc38-699362e67295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:22.824544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33b080a1-49a5-4051-bc38-699362e67295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:22.853621 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-33b080a1-49a5-4051-bc38-699362e67295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047761 May 24 13:16:22.854163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 473/939] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:23.865246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2bed8fd4-befe-4ec6-add4-1f79f8517184 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:23.866464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2bed8fd4-befe-4ec6-add4-1f79f8517184 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:23.873454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bed8fd4-befe-4ec6-add4-1f79f8517184 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:23.873901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bed8fd4-befe-4ec6-add4-1f79f8517184 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:23.874698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bed8fd4-befe-4ec6-add4-1f79f8517184 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:23.875133 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bed8fd4-befe-4ec6-add4-1f79f8517184 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:23.909479 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2bed8fd4-befe-4ec6-add4-1f79f8517184 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048227 May 24 13:16:23.910033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 467/940] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:24.921044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fcb59302-67f2-4ab7-b6ac-3709341a7ff3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:24.921957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fcb59302-67f2-4ab7-b6ac-3709341a7ff3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:24.928356 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcb59302-67f2-4ab7-b6ac-3709341a7ff3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:24.928802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcb59302-67f2-4ab7-b6ac-3709341a7ff3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:24.929551 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcb59302-67f2-4ab7-b6ac-3709341a7ff3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:24.929981 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcb59302-67f2-4ab7-b6ac-3709341a7ff3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:24.958768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fcb59302-67f2-4ab7-b6ac-3709341a7ff3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041659 May 24 13:16:24.959299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 474/941] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:25.970819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-39f2d0c6-72f6-417e-9087-4eea1953d336 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:25.971673 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-39f2d0c6-72f6-417e-9087-4eea1953d336 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:25.978363 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39f2d0c6-72f6-417e-9087-4eea1953d336 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:25.978822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39f2d0c6-72f6-417e-9087-4eea1953d336 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:25.979593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39f2d0c6-72f6-417e-9087-4eea1953d336 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:25.980033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39f2d0c6-72f6-417e-9087-4eea1953d336 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:26.014538 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-39f2d0c6-72f6-417e-9087-4eea1953d336 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047738 May 24 13:16:26.015095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 468/942] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:27.025592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b130442e-63a2-4888-90cb-296a8a039db6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:27.026533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b130442e-63a2-4888-90cb-296a8a039db6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:27.033875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b130442e-63a2-4888-90cb-296a8a039db6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:27.034359 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b130442e-63a2-4888-90cb-296a8a039db6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:27.035127 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b130442e-63a2-4888-90cb-296a8a039db6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:27.035566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b130442e-63a2-4888-90cb-296a8a039db6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:27.064531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b130442e-63a2-4888-90cb-296a8a039db6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042824 May 24 13:16:27.065081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 475/943] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:28.076284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-77f1a0d7-3d3a-481a-b38f-f95740f10097 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:28.077211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-77f1a0d7-3d3a-481a-b38f-f95740f10097 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:28.083785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77f1a0d7-3d3a-481a-b38f-f95740f10097 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:28.084238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77f1a0d7-3d3a-481a-b38f-f95740f10097 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:28.085033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77f1a0d7-3d3a-481a-b38f-f95740f10097 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:28.085475 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77f1a0d7-3d3a-481a-b38f-f95740f10097 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:28.114634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-77f1a0d7-3d3a-481a-b38f-f95740f10097 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042361 May 24 13:16:28.115184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 469/944] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:29.126550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f6742e19-4238-4760-a545-dc86874cc49f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:29.127531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f6742e19-4238-4760-a545-dc86874cc49f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:29.134008 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f6742e19-4238-4760-a545-dc86874cc49f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:29.134498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f6742e19-4238-4760-a545-dc86874cc49f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:29.135271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f6742e19-4238-4760-a545-dc86874cc49f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:29.135711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f6742e19-4238-4760-a545-dc86874cc49f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:29.164937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f6742e19-4238-4760-a545-dc86874cc49f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042447 May 24 13:16:29.165483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 476/945] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:30.177207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e1d1057-4f68-4ec7-a4b9-a5bcb95f01bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:30.178148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e1d1057-4f68-4ec7-a4b9-a5bcb95f01bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:30.185290 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e1d1057-4f68-4ec7-a4b9-a5bcb95f01bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:30.185744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e1d1057-4f68-4ec7-a4b9-a5bcb95f01bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:30.186532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e1d1057-4f68-4ec7-a4b9-a5bcb95f01bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:30.186975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e1d1057-4f68-4ec7-a4b9-a5bcb95f01bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:30.215613 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e1d1057-4f68-4ec7-a4b9-a5bcb95f01bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042411 May 24 13:16:30.216104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 470/946] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:31.227759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-46014113-4937-48f8-b852-23364bf0313c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:31.228680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-46014113-4937-48f8-b852-23364bf0313c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:31.235920 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-46014113-4937-48f8-b852-23364bf0313c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:31.236370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-46014113-4937-48f8-b852-23364bf0313c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:31.237143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-46014113-4937-48f8-b852-23364bf0313c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:31.237583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-46014113-4937-48f8-b852-23364bf0313c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:31.269383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-46014113-4937-48f8-b852-23364bf0313c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045664 May 24 13:16:31.269923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 477/947] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:31.765481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:31.765986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:31.772424 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:31.772877 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:31.773643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:31.774082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:31.787388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] HTTP exception thrown: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Request method failure captured: May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b HTTP/1.1 May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNbZoQy-eR6FHCFODsrK1xBISdBLWpwyMp6dg7yRQRwGroYtc1-dSGvt5AdTvnp7FEoW1Xyxx5-Kmg0aHlgoIWJlk6ZbcODSL2sqXnQ3_jkyBEaHJuGuLt1dIeCk1FofyWKyjZaTfkIP8sZB7SHcX8royL2ZXZTfs_libM9gJbh_Izg May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Openstack-Nova-Api-Version: 2.20 May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: e57720cd453848a89315ad87ace38161 May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:16:31.789132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e57720cd453848a89315ad87ace38161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e57720cd453848a89315ad87ace38161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: e57720cd453848a89315ad87ace38161 May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: f7b0dfb3d6514817aba4ab34fd972ba1 May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.790909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '29462bbf-3714-42f0-893e-fb7de5ca0d2b'} May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:16:31.792148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.794224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:16:31.795813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Returning 404 to user: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:16:31.795813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a78e77c7-7df6-4e48-b98d-50194ff63dfd tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 404 len: 111 microversion: 2.20 time: 0.028780 May 24 13:16:31.795813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 471/948] 10.222.0.45 () {60 vars in 1279 bytes} [Tue May 24 13:16:31 2022] DELETE /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 13:16:31.802584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:31.802584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 29462bbf-3714-42f0-893e-fb7de5ca0d2b] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:31.808100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:31.808555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:31.809898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:31.810528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:31.823536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] HTTP exception thrown: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Request method failure captured: May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b HTTP/1.1 May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbZoQy-eR6FHCFODsrK1xBISdBLWpwyMp6dg7yRQRwGroYtc1-dSGvt5AdTvnp7FEoW1Xyxx5-Kmg0aHlgoIWJlk6ZbcODSL2sqXnQ3_jkyBEaHJuGuLt1dIeCk1FofyWKyjZaTfkIP8sZB7SHcX8royL2ZXZTfs_libM9gJbh_Izg May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Openstack-Nova-Api-Version: 2.20 May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: e57720cd453848a89315ad87ace38161 May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:16:31.825517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e57720cd453848a89315ad87ace38161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e57720cd453848a89315ad87ace38161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: e57720cd453848a89315ad87ace38161 May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: f7b0dfb3d6514817aba4ab34fd972ba1 May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.828573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '29462bbf-3714-42f0-893e-fb7de5ca0d2b'} May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:16:31.830714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. May 24 13:16:31.832258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:16:31.834311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Returning 404 to user: Instance 29462bbf-3714-42f0-893e-fb7de5ca0d2b could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:16:31.834311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-97462ad9-2397-4cd7-bdbe-095d10d9f446 tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b" status: 404 len: 111 microversion: 2.20 time: 0.029062 May 24 13:16:31.834311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 478/949] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:16:31 2022] GET /compute/v2.1/servers/29462bbf-3714-42f0-893e-fb7de5ca0d2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 13:16:32.281788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-255be1d3-c3f0-4c88-af97-d9bb0bc3df4c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:32.282737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-255be1d3-c3f0-4c88-af97-d9bb0bc3df4c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:32.288765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-255be1d3-c3f0-4c88-af97-d9bb0bc3df4c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:32.289147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-255be1d3-c3f0-4c88-af97-d9bb0bc3df4c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:32.289903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-255be1d3-c3f0-4c88-af97-d9bb0bc3df4c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:32.290369 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-255be1d3-c3f0-4c88-af97-d9bb0bc3df4c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:32.319613 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-255be1d3-c3f0-4c88-af97-d9bb0bc3df4c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042470 May 24 13:16:32.320149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 472/950] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:33.331132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a73eb0c5-6b5f-42fb-8589-f1c61953b603 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:33.332083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a73eb0c5-6b5f-42fb-8589-f1c61953b603 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:33.338572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a73eb0c5-6b5f-42fb-8589-f1c61953b603 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:33.339021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a73eb0c5-6b5f-42fb-8589-f1c61953b603 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:33.339774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a73eb0c5-6b5f-42fb-8589-f1c61953b603 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:33.340211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a73eb0c5-6b5f-42fb-8589-f1c61953b603 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:33.369001 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a73eb0c5-6b5f-42fb-8589-f1c61953b603 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041853 May 24 13:16:33.369534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 479/951] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:34.381247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60e0e27a-9541-401d-a155-9ea8bb6d9814 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:34.382207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60e0e27a-9541-401d-a155-9ea8bb6d9814 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:34.389427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60e0e27a-9541-401d-a155-9ea8bb6d9814 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:34.389876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60e0e27a-9541-401d-a155-9ea8bb6d9814 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:34.390703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60e0e27a-9541-401d-a155-9ea8bb6d9814 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:34.391140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60e0e27a-9541-401d-a155-9ea8bb6d9814 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:34.420029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60e0e27a-9541-401d-a155-9ea8bb6d9814 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042712 May 24 13:16:34.420579 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 473/952] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:35.431475 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6e3f8f16-094b-4784-a6c6-40f89ed2ec3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:35.432399 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6e3f8f16-094b-4784-a6c6-40f89ed2ec3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:35.438940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e3f8f16-094b-4784-a6c6-40f89ed2ec3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:35.439391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e3f8f16-094b-4784-a6c6-40f89ed2ec3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:35.440154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e3f8f16-094b-4784-a6c6-40f89ed2ec3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:35.440598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6e3f8f16-094b-4784-a6c6-40f89ed2ec3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:35.470052 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6e3f8f16-094b-4784-a6c6-40f89ed2ec3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042509 May 24 13:16:35.470698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 480/953] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:36.481099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f35e0da9-0920-49c5-b0ef-427d4577609e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:36.482021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f35e0da9-0920-49c5-b0ef-427d4577609e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:36.489261 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f35e0da9-0920-49c5-b0ef-427d4577609e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:36.489715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f35e0da9-0920-49c5-b0ef-427d4577609e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:36.490502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f35e0da9-0920-49c5-b0ef-427d4577609e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:36.491197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f35e0da9-0920-49c5-b0ef-427d4577609e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:36.520055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f35e0da9-0920-49c5-b0ef-427d4577609e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042952 May 24 13:16:36.520599 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 474/954] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:37.532698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8c5e0098-f2e4-4dda-a46c-3a9f461d533d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:37.533625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8c5e0098-f2e4-4dda-a46c-3a9f461d533d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:37.540361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8c5e0098-f2e4-4dda-a46c-3a9f461d533d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:37.540817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8c5e0098-f2e4-4dda-a46c-3a9f461d533d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:37.541581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8c5e0098-f2e4-4dda-a46c-3a9f461d533d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:37.542023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8c5e0098-f2e4-4dda-a46c-3a9f461d533d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:37.572010 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8c5e0098-f2e4-4dda-a46c-3a9f461d533d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044004 May 24 13:16:37.572558 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 481/955] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:38.583572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ba510b8a-459a-499e-a180-81c7ab9d3e0d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:38.584502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ba510b8a-459a-499e-a180-81c7ab9d3e0d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:38.591002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba510b8a-459a-499e-a180-81c7ab9d3e0d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:38.592049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba510b8a-459a-499e-a180-81c7ab9d3e0d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:38.592815 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba510b8a-459a-499e-a180-81c7ab9d3e0d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:38.593253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba510b8a-459a-499e-a180-81c7ab9d3e0d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:38.621987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ba510b8a-459a-499e-a180-81c7ab9d3e0d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042367 May 24 13:16:38.622552 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 475/956] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:39.633320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-558f5f1f-2b79-4af7-a86f-eebd68880b40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:39.634249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-558f5f1f-2b79-4af7-a86f-eebd68880b40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:39.640807 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-558f5f1f-2b79-4af7-a86f-eebd68880b40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:39.641258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-558f5f1f-2b79-4af7-a86f-eebd68880b40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:39.642021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-558f5f1f-2b79-4af7-a86f-eebd68880b40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:39.642504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-558f5f1f-2b79-4af7-a86f-eebd68880b40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:39.671894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-558f5f1f-2b79-4af7-a86f-eebd68880b40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042453 May 24 13:16:39.672365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 482/957] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:40.673386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:16:40.673997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:16:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:16:40.683283 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7f3f8e89-39e7-4b01-a573-7ce84b834798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:40.684203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7f3f8e89-39e7-4b01-a573-7ce84b834798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:40.691291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7f3f8e89-39e7-4b01-a573-7ce84b834798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:40.691743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7f3f8e89-39e7-4b01-a573-7ce84b834798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:40.692500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7f3f8e89-39e7-4b01-a573-7ce84b834798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:40.692933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7f3f8e89-39e7-4b01-a573-7ce84b834798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:40.721918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7f3f8e89-39e7-4b01-a573-7ce84b834798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042639 May 24 13:16:40.722480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 476/958] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:16:41.734096 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-33eaa317-0b02-431c-b76c-88cdb537ffde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:41.735040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-33eaa317-0b02-431c-b76c-88cdb537ffde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:41.741776 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33eaa317-0b02-431c-b76c-88cdb537ffde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:41.742225 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33eaa317-0b02-431c-b76c-88cdb537ffde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:41.743015 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33eaa317-0b02-431c-b76c-88cdb537ffde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:41.743447 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33eaa317-0b02-431c-b76c-88cdb537ffde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:41.771988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-33eaa317-0b02-431c-b76c-88cdb537ffde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042437 May 24 13:16:41.772522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 483/959] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:42.782979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-217ddaae-080e-4747-9eb4-5e5a6702bc92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:42.783907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-217ddaae-080e-4747-9eb4-5e5a6702bc92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:42.790469 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-217ddaae-080e-4747-9eb4-5e5a6702bc92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:42.790920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-217ddaae-080e-4747-9eb4-5e5a6702bc92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:42.791680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-217ddaae-080e-4747-9eb4-5e5a6702bc92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:42.792118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-217ddaae-080e-4747-9eb4-5e5a6702bc92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:42.822728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-217ddaae-080e-4747-9eb4-5e5a6702bc92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043736 May 24 13:16:42.823283 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 477/960] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:43.834294 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e57c99b6-b27d-4a2b-b3e2-69d2d4ff138a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:43.835223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e57c99b6-b27d-4a2b-b3e2-69d2d4ff138a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:43.842243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e57c99b6-b27d-4a2b-b3e2-69d2d4ff138a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:43.842720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e57c99b6-b27d-4a2b-b3e2-69d2d4ff138a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:43.843476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e57c99b6-b27d-4a2b-b3e2-69d2d4ff138a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:43.843908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e57c99b6-b27d-4a2b-b3e2-69d2d4ff138a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:43.872243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e57c99b6-b27d-4a2b-b3e2-69d2d4ff138a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041876 May 24 13:16:43.873277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 484/961] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:44.884252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3dca98b2-11b7-4559-8e9d-85570d24a3d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:44.885173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3dca98b2-11b7-4559-8e9d-85570d24a3d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:44.891690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dca98b2-11b7-4559-8e9d-85570d24a3d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:44.892143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dca98b2-11b7-4559-8e9d-85570d24a3d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:44.892903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dca98b2-11b7-4559-8e9d-85570d24a3d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:44.893340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dca98b2-11b7-4559-8e9d-85570d24a3d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:44.922892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3dca98b2-11b7-4559-8e9d-85570d24a3d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042643 May 24 13:16:44.923429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 478/962] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:45.934342 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3cfd7928-1013-4901-889e-5331f264cf3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:45.936450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3cfd7928-1013-4901-889e-5331f264cf3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:45.938328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=33 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:16:45.944700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3cfd7928-1013-4901-889e-5331f264cf3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:45.945158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3cfd7928-1013-4901-889e-5331f264cf3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:45.945930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3cfd7928-1013-4901-889e-5331f264cf3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:45.946402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3cfd7928-1013-4901-889e-5331f264cf3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:45.948997 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:16:45.977780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3cfd7928-1013-4901-889e-5331f264cf3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047458 May 24 13:16:45.978344 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 485/963] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:46.989482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d5c386b-d8bd-41a6-9030-30f129b9b04b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:46.990795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d5c386b-d8bd-41a6-9030-30f129b9b04b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:46.993172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=33 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:16:46.998526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d5c386b-d8bd-41a6-9030-30f129b9b04b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:46.998984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d5c386b-d8bd-41a6-9030-30f129b9b04b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:46.999754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d5c386b-d8bd-41a6-9030-30f129b9b04b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:47.000198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d5c386b-d8bd-41a6-9030-30f129b9b04b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:47.003935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=93 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:16:47.029884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d5c386b-d8bd-41a6-9030-30f129b9b04b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044426 May 24 13:16:47.030460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 479/964] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:48.041622 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-df0b8601-8ca2-4d82-bc6b-18b895c04944 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:48.042699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-df0b8601-8ca2-4d82-bc6b-18b895c04944 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:48.048883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-df0b8601-8ca2-4d82-bc6b-18b895c04944 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:48.049332 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-df0b8601-8ca2-4d82-bc6b-18b895c04944 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:48.050086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-df0b8601-8ca2-4d82-bc6b-18b895c04944 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:48.050546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-df0b8601-8ca2-4d82-bc6b-18b895c04944 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:48.079589 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-df0b8601-8ca2-4d82-bc6b-18b895c04944 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042026 May 24 13:16:48.080139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 486/965] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:49.091820 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-10df888c-9bf7-4ab2-965b-a57a24d69bf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:49.092754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-10df888c-9bf7-4ab2-965b-a57a24d69bf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:49.099200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10df888c-9bf7-4ab2-965b-a57a24d69bf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:49.099652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10df888c-9bf7-4ab2-965b-a57a24d69bf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:49.100443 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10df888c-9bf7-4ab2-965b-a57a24d69bf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:49.100881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10df888c-9bf7-4ab2-965b-a57a24d69bf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:49.130550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-10df888c-9bf7-4ab2-965b-a57a24d69bf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043167 May 24 13:16:49.131099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 480/966] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:50.142636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7324aea2-4a1f-4d24-aaba-05a2453235d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:50.143571 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7324aea2-4a1f-4d24-aaba-05a2453235d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:50.150089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7324aea2-4a1f-4d24-aaba-05a2453235d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:50.150579 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7324aea2-4a1f-4d24-aaba-05a2453235d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:50.151351 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7324aea2-4a1f-4d24-aaba-05a2453235d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:50.151796 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7324aea2-4a1f-4d24-aaba-05a2453235d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:50.180293 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7324aea2-4a1f-4d24-aaba-05a2453235d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042263 May 24 13:16:50.180842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 487/967] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:50.263544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:16:50.263686 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:16:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:16:51.191841 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8e96d74c-f1b4-4ed8-a6b5-29e992d7437e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:51.192760 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8e96d74c-f1b4-4ed8-a6b5-29e992d7437e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:51.199154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e96d74c-f1b4-4ed8-a6b5-29e992d7437e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:51.199644 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e96d74c-f1b4-4ed8-a6b5-29e992d7437e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:51.200405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e96d74c-f1b4-4ed8-a6b5-29e992d7437e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:51.201348 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e96d74c-f1b4-4ed8-a6b5-29e992d7437e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:51.230392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8e96d74c-f1b4-4ed8-a6b5-29e992d7437e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042521 May 24 13:16:51.230928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 481/968] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:52.242228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3895aa00-0c05-4e0e-8436-e48ba1c5b2ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:52.243200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3895aa00-0c05-4e0e-8436-e48ba1c5b2ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:52.249866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3895aa00-0c05-4e0e-8436-e48ba1c5b2ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:52.250340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3895aa00-0c05-4e0e-8436-e48ba1c5b2ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:52.251097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3895aa00-0c05-4e0e-8436-e48ba1c5b2ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:52.251527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3895aa00-0c05-4e0e-8436-e48ba1c5b2ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:52.281393 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3895aa00-0c05-4e0e-8436-e48ba1c5b2ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043506 May 24 13:16:52.281919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 488/969] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:53.293833 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-82af6a6d-1c22-4838-9eb5-4d9d5ef3ebfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:53.295282 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-82af6a6d-1c22-4838-9eb5-4d9d5ef3ebfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:53.301765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82af6a6d-1c22-4838-9eb5-4d9d5ef3ebfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:53.302209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82af6a6d-1c22-4838-9eb5-4d9d5ef3ebfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:53.302992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82af6a6d-1c22-4838-9eb5-4d9d5ef3ebfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:53.303427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82af6a6d-1c22-4838-9eb5-4d9d5ef3ebfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:53.332918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-82af6a6d-1c22-4838-9eb5-4d9d5ef3ebfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043511 May 24 13:16:53.333463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 482/970] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:54.344993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a334ddc4-7bbc-496a-9e69-9b7421a41e40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:54.345918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a334ddc4-7bbc-496a-9e69-9b7421a41e40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:54.352432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a334ddc4-7bbc-496a-9e69-9b7421a41e40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:54.352909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a334ddc4-7bbc-496a-9e69-9b7421a41e40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:54.353699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a334ddc4-7bbc-496a-9e69-9b7421a41e40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:54.354136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a334ddc4-7bbc-496a-9e69-9b7421a41e40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:54.383184 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a334ddc4-7bbc-496a-9e69-9b7421a41e40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042832 May 24 13:16:54.383733 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 489/971] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:55.394544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b37f1af9-2e17-4643-b0ee-c6c0b36c2b19 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:55.395472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b37f1af9-2e17-4643-b0ee-c6c0b36c2b19 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:55.402099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b37f1af9-2e17-4643-b0ee-c6c0b36c2b19 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:55.402581 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b37f1af9-2e17-4643-b0ee-c6c0b36c2b19 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:55.403347 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b37f1af9-2e17-4643-b0ee-c6c0b36c2b19 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:55.404293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b37f1af9-2e17-4643-b0ee-c6c0b36c2b19 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:55.435403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b37f1af9-2e17-4643-b0ee-c6c0b36c2b19 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045033 May 24 13:16:55.435954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 483/972] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:56.446982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4f03ec26-3bd8-453f-953d-d0c33e21ffb2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:56.447914 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4f03ec26-3bd8-453f-953d-d0c33e21ffb2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:56.454495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f03ec26-3bd8-453f-953d-d0c33e21ffb2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:56.454951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f03ec26-3bd8-453f-953d-d0c33e21ffb2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:56.455713 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f03ec26-3bd8-453f-953d-d0c33e21ffb2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:56.456179 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f03ec26-3bd8-453f-953d-d0c33e21ffb2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:56.485465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4f03ec26-3bd8-453f-953d-d0c33e21ffb2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042418 May 24 13:16:56.486021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 490/973] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:57.496822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-85e5e075-9028-44d9-8056-543751138f8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:57.497748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-85e5e075-9028-44d9-8056-543751138f8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:57.505005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85e5e075-9028-44d9-8056-543751138f8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:57.505448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85e5e075-9028-44d9-8056-543751138f8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:57.506201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85e5e075-9028-44d9-8056-543751138f8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:57.506667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85e5e075-9028-44d9-8056-543751138f8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:57.537023 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-85e5e075-9028-44d9-8056-543751138f8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044251 May 24 13:16:57.537574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 484/974] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:58.548590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c9f66782-0ba9-49d5-ab2e-3ba47d3fd40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:58.549549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c9f66782-0ba9-49d5-ab2e-3ba47d3fd40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:58.556161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9f66782-0ba9-49d5-ab2e-3ba47d3fd40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:58.556610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9f66782-0ba9-49d5-ab2e-3ba47d3fd40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:58.557365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9f66782-0ba9-49d5-ab2e-3ba47d3fd40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:58.557833 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9f66782-0ba9-49d5-ab2e-3ba47d3fd40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:58.586757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c9f66782-0ba9-49d5-ab2e-3ba47d3fd40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042107 May 24 13:16:58.587303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 491/975] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:58 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:16:59.598833 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b49c156a-35c0-44ed-97a7-e5cb09b84cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:16:59.599761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b49c156a-35c0-44ed-97a7-e5cb09b84cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:16:59.606369 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b49c156a-35c0-44ed-97a7-e5cb09b84cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:59.606819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b49c156a-35c0-44ed-97a7-e5cb09b84cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:59.607578 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b49c156a-35c0-44ed-97a7-e5cb09b84cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:16:59.608630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b49c156a-35c0-44ed-97a7-e5cb09b84cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:16:59.637021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b49c156a-35c0-44ed-97a7-e5cb09b84cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042134 May 24 13:16:59.637552 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 485/976] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:16:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:00.648855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-29dc40a3-748c-43f7-abfc-187e628dd943 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:00.649701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-29dc40a3-748c-43f7-abfc-187e628dd943 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:00.656246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-29dc40a3-748c-43f7-abfc-187e628dd943 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:00.656704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-29dc40a3-748c-43f7-abfc-187e628dd943 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:00.657463 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-29dc40a3-748c-43f7-abfc-187e628dd943 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:00.657901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-29dc40a3-748c-43f7-abfc-187e628dd943 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:00.686764 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-29dc40a3-748c-43f7-abfc-187e628dd943 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041337 May 24 13:17:00.687304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 492/977] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:01.698183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1fbdff3e-dfae-45c9-a0c2-d018078c4060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:01.699129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1fbdff3e-dfae-45c9-a0c2-d018078c4060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:01.705515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fbdff3e-dfae-45c9-a0c2-d018078c4060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:01.705959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fbdff3e-dfae-45c9-a0c2-d018078c4060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:01.706741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fbdff3e-dfae-45c9-a0c2-d018078c4060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:01.707175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fbdff3e-dfae-45c9-a0c2-d018078c4060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:01.735869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1fbdff3e-dfae-45c9-a0c2-d018078c4060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041618 May 24 13:17:01.736406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 486/978] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:02.747453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a01947d2-20e9-40f8-83cc-119a2e168ced tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:02.748998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a01947d2-20e9-40f8-83cc-119a2e168ced tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:02.755712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a01947d2-20e9-40f8-83cc-119a2e168ced tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:02.756161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a01947d2-20e9-40f8-83cc-119a2e168ced tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:02.756919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a01947d2-20e9-40f8-83cc-119a2e168ced tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:02.757351 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a01947d2-20e9-40f8-83cc-119a2e168ced tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:02.788207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a01947d2-20e9-40f8-83cc-119a2e168ced tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044667 May 24 13:17:02.788769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 493/979] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:17:03.799900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b286ab24-95eb-4b69-b100-85efb6276d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:03.800732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b286ab24-95eb-4b69-b100-85efb6276d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:03.807274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b286ab24-95eb-4b69-b100-85efb6276d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:03.807728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b286ab24-95eb-4b69-b100-85efb6276d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:03.808489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b286ab24-95eb-4b69-b100-85efb6276d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:03.808918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b286ab24-95eb-4b69-b100-85efb6276d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:03.839396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b286ab24-95eb-4b69-b100-85efb6276d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043486 May 24 13:17:03.840146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 487/980] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:04.850896 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ec0218b6-42e3-49fd-8aa6-1ea6591bd6f8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:04.851816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ec0218b6-42e3-49fd-8aa6-1ea6591bd6f8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:04.858957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec0218b6-42e3-49fd-8aa6-1ea6591bd6f8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:04.859411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec0218b6-42e3-49fd-8aa6-1ea6591bd6f8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:04.860162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec0218b6-42e3-49fd-8aa6-1ea6591bd6f8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:04.860598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec0218b6-42e3-49fd-8aa6-1ea6591bd6f8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:04.890729 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ec0218b6-42e3-49fd-8aa6-1ea6591bd6f8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043731 May 24 13:17:04.891286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 494/981] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:05.901192 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-feadcfd0-a637-4d3a-8543-4bc46d474c7d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:05.902138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-feadcfd0-a637-4d3a-8543-4bc46d474c7d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:05.908454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-feadcfd0-a637-4d3a-8543-4bc46d474c7d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:05.908904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-feadcfd0-a637-4d3a-8543-4bc46d474c7d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:05.909676 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-feadcfd0-a637-4d3a-8543-4bc46d474c7d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:05.910113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-feadcfd0-a637-4d3a-8543-4bc46d474c7d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:05.939349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-feadcfd0-a637-4d3a-8543-4bc46d474c7d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042056 May 24 13:17:05.939891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 488/982] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:06.950773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f572ef97-5a16-4418-b458-6b936a58b2be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:06.951698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f572ef97-5a16-4418-b458-6b936a58b2be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:06.958150 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f572ef97-5a16-4418-b458-6b936a58b2be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:06.958632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f572ef97-5a16-4418-b458-6b936a58b2be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:06.959394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f572ef97-5a16-4418-b458-6b936a58b2be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:06.959830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f572ef97-5a16-4418-b458-6b936a58b2be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:06.994489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f572ef97-5a16-4418-b458-6b936a58b2be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047601 May 24 13:17:06.995038 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 495/983] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:08.006827 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-05a970e6-f673-496e-9f7b-7174f2f2c83c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:08.007783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-05a970e6-f673-496e-9f7b-7174f2f2c83c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:08.014850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05a970e6-f673-496e-9f7b-7174f2f2c83c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:08.015302 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05a970e6-f673-496e-9f7b-7174f2f2c83c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:08.016065 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05a970e6-f673-496e-9f7b-7174f2f2c83c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:08.016508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05a970e6-f673-496e-9f7b-7174f2f2c83c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:08.046255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-05a970e6-f673-496e-9f7b-7174f2f2c83c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043426 May 24 13:17:08.046886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 489/984] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:09.056941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-adc6fa9f-2aaa-41ed-9f08-473854dd01cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:09.057888 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-adc6fa9f-2aaa-41ed-9f08-473854dd01cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:09.065134 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adc6fa9f-2aaa-41ed-9f08-473854dd01cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:09.065579 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adc6fa9f-2aaa-41ed-9f08-473854dd01cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:09.066385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adc6fa9f-2aaa-41ed-9f08-473854dd01cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:09.066821 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adc6fa9f-2aaa-41ed-9f08-473854dd01cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:09.094932 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-adc6fa9f-2aaa-41ed-9f08-473854dd01cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041898 May 24 13:17:09.095459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 496/985] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:10.106543 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f8588922-d3e3-474f-b790-90d4cd522418 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:10.107501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f8588922-d3e3-474f-b790-90d4cd522418 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:10.114024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8588922-d3e3-474f-b790-90d4cd522418 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:10.114511 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8588922-d3e3-474f-b790-90d4cd522418 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:10.115541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8588922-d3e3-474f-b790-90d4cd522418 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:10.115978 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8588922-d3e3-474f-b790-90d4cd522418 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:10.146017 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f8588922-d3e3-474f-b790-90d4cd522418 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043479 May 24 13:17:10.146604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 490/986] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:11.157495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5e06ab0e-78e3-4ae5-b77f-efd11c67e35c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:11.158441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5e06ab0e-78e3-4ae5-b77f-efd11c67e35c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:11.164802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e06ab0e-78e3-4ae5-b77f-efd11c67e35c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:11.165248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e06ab0e-78e3-4ae5-b77f-efd11c67e35c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:11.166003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e06ab0e-78e3-4ae5-b77f-efd11c67e35c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:11.166465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e06ab0e-78e3-4ae5-b77f-efd11c67e35c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:11.198522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5e06ab0e-78e3-4ae5-b77f-efd11c67e35c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044870 May 24 13:17:11.199092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 497/987] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:12.211542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-96a4ebbf-605e-481d-abc2-7e4f9186551b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:12.212464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-96a4ebbf-605e-481d-abc2-7e4f9186551b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:12.219683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96a4ebbf-605e-481d-abc2-7e4f9186551b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:12.220137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96a4ebbf-605e-481d-abc2-7e4f9186551b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:12.220910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96a4ebbf-605e-481d-abc2-7e4f9186551b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:12.221350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96a4ebbf-605e-481d-abc2-7e4f9186551b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:12.250147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-96a4ebbf-605e-481d-abc2-7e4f9186551b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042705 May 24 13:17:12.250732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 491/988] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:13.261580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-38e3c299-edcc-4740-a04f-b9af4257dccf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:13.262607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-38e3c299-edcc-4740-a04f-b9af4257dccf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:13.269087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38e3c299-edcc-4740-a04f-b9af4257dccf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:13.269542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38e3c299-edcc-4740-a04f-b9af4257dccf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:13.270329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38e3c299-edcc-4740-a04f-b9af4257dccf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:13.270773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38e3c299-edcc-4740-a04f-b9af4257dccf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:13.300040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-38e3c299-edcc-4740-a04f-b9af4257dccf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042391 May 24 13:17:13.300574 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 498/989] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:14.311483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f0af9caa-b13d-4ec5-8ca7-68405fc2b740 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:14.313088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f0af9caa-b13d-4ec5-8ca7-68405fc2b740 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:14.319617 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0af9caa-b13d-4ec5-8ca7-68405fc2b740 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:14.320070 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0af9caa-b13d-4ec5-8ca7-68405fc2b740 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:14.320835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0af9caa-b13d-4ec5-8ca7-68405fc2b740 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:14.321274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0af9caa-b13d-4ec5-8ca7-68405fc2b740 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:14.349734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f0af9caa-b13d-4ec5-8ca7-68405fc2b740 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042158 May 24 13:17:14.350206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 492/990] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:15.362123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-560e0724-01f9-4276-89c2-a4dd8a78beb4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:15.363071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-560e0724-01f9-4276-89c2-a4dd8a78beb4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:15.369878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-560e0724-01f9-4276-89c2-a4dd8a78beb4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:15.370277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-560e0724-01f9-4276-89c2-a4dd8a78beb4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:15.371066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-560e0724-01f9-4276-89c2-a4dd8a78beb4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:15.371496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-560e0724-01f9-4276-89c2-a4dd8a78beb4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:15.400107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-560e0724-01f9-4276-89c2-a4dd8a78beb4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042485 May 24 13:17:15.400652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 499/991] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:16.412037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a6e5f6d1-74a4-4963-a84f-998fe7337645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:16.412900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a6e5f6d1-74a4-4963-a84f-998fe7337645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:16.419329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6e5f6d1-74a4-4963-a84f-998fe7337645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:16.419779 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6e5f6d1-74a4-4963-a84f-998fe7337645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:16.420535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6e5f6d1-74a4-4963-a84f-998fe7337645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:16.420970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6e5f6d1-74a4-4963-a84f-998fe7337645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:16.450256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a6e5f6d1-74a4-4963-a84f-998fe7337645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042566 May 24 13:17:16.450818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 493/992] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:17.461737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c1ffdf53-9161-4e55-8393-19a88be737ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:17.462704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c1ffdf53-9161-4e55-8393-19a88be737ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:17.464533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:17:17.470475 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1ffdf53-9161-4e55-8393-19a88be737ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:17.470923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1ffdf53-9161-4e55-8393-19a88be737ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:17.471677 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1ffdf53-9161-4e55-8393-19a88be737ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:17.472109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c1ffdf53-9161-4e55-8393-19a88be737ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:17.474642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:17:17.502220 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c1ffdf53-9161-4e55-8393-19a88be737ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044561 May 24 13:17:17.502815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 500/993] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:18.513521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bcc914f0-a114-4762-a276-2c71bea2e956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:18.514494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bcc914f0-a114-4762-a276-2c71bea2e956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:18.516550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:17:18.521881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcc914f0-a114-4762-a276-2c71bea2e956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:18.522398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcc914f0-a114-4762-a276-2c71bea2e956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:18.523191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcc914f0-a114-4762-a276-2c71bea2e956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:18.523633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcc914f0-a114-4762-a276-2c71bea2e956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:18.526614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:17:18.557197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bcc914f0-a114-4762-a276-2c71bea2e956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047862 May 24 13:17:18.557880 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 494/994] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:19.568798 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a5ea8d7f-9331-4f9d-b2f0-892f71e27f98 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:19.569756 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a5ea8d7f-9331-4f9d-b2f0-892f71e27f98 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:19.576356 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5ea8d7f-9331-4f9d-b2f0-892f71e27f98 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:19.576799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5ea8d7f-9331-4f9d-b2f0-892f71e27f98 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:19.578063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5ea8d7f-9331-4f9d-b2f0-892f71e27f98 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:19.578524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5ea8d7f-9331-4f9d-b2f0-892f71e27f98 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:19.607387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a5ea8d7f-9331-4f9d-b2f0-892f71e27f98 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042611 May 24 13:17:19.607925 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 501/995] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:20.619252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cdcbd3ff-d7b8-42e8-8fef-eed67b45b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:20.620176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cdcbd3ff-d7b8-42e8-8fef-eed67b45b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:20.626729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdcbd3ff-d7b8-42e8-8fef-eed67b45b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:20.627181 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdcbd3ff-d7b8-42e8-8fef-eed67b45b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:20.627948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdcbd3ff-d7b8-42e8-8fef-eed67b45b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:20.628385 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdcbd3ff-d7b8-42e8-8fef-eed67b45b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:20.657917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cdcbd3ff-d7b8-42e8-8fef-eed67b45b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042823 May 24 13:17:20.658427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 495/996] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:21.669595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-143c5dda-da1a-4beb-9011-5b949ad9ce4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:21.670479 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-143c5dda-da1a-4beb-9011-5b949ad9ce4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:21.677439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-143c5dda-da1a-4beb-9011-5b949ad9ce4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:21.677885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-143c5dda-da1a-4beb-9011-5b949ad9ce4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:21.678674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-143c5dda-da1a-4beb-9011-5b949ad9ce4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:21.679105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-143c5dda-da1a-4beb-9011-5b949ad9ce4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:21.707891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-143c5dda-da1a-4beb-9011-5b949ad9ce4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042414 May 24 13:17:21.708422 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 502/997] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:22.719506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f660e51c-bc50-4764-aec7-64b08775e3a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:22.720425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f660e51c-bc50-4764-aec7-64b08775e3a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:22.726919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f660e51c-bc50-4764-aec7-64b08775e3a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:22.727370 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f660e51c-bc50-4764-aec7-64b08775e3a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:22.728135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f660e51c-bc50-4764-aec7-64b08775e3a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:22.728570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f660e51c-bc50-4764-aec7-64b08775e3a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:22.758375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f660e51c-bc50-4764-aec7-64b08775e3a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042855 May 24 13:17:22.758919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 496/998] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:23.771319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-147fa9e5-c119-48ff-be23-64d60034e0b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:23.772251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-147fa9e5-c119-48ff-be23-64d60034e0b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:23.778723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-147fa9e5-c119-48ff-be23-64d60034e0b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:23.779171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-147fa9e5-c119-48ff-be23-64d60034e0b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:23.779929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-147fa9e5-c119-48ff-be23-64d60034e0b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:23.780361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-147fa9e5-c119-48ff-be23-64d60034e0b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:23.810768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-147fa9e5-c119-48ff-be23-64d60034e0b2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044863 May 24 13:17:23.811315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 503/999] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:24.823056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f5dd869c-5780-4cce-88f0-3730b925435b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:24.823981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f5dd869c-5780-4cce-88f0-3730b925435b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:24.831049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5dd869c-5780-4cce-88f0-3730b925435b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:24.831503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5dd869c-5780-4cce-88f0-3730b925435b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:24.832263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5dd869c-5780-4cce-88f0-3730b925435b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:24.832700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5dd869c-5780-4cce-88f0-3730b925435b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:24.861704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f5dd869c-5780-4cce-88f0-3730b925435b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042675 May 24 13:17:24.862256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 497/1000] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:25.873743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f3125b3d-c15e-4121-8055-70697ad71d33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:25.874694 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f3125b3d-c15e-4121-8055-70697ad71d33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:25.881128 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f3125b3d-c15e-4121-8055-70697ad71d33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:25.881580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f3125b3d-c15e-4121-8055-70697ad71d33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:25.882373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f3125b3d-c15e-4121-8055-70697ad71d33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:25.882817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f3125b3d-c15e-4121-8055-70697ad71d33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:25.911441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f3125b3d-c15e-4121-8055-70697ad71d33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041773 May 24 13:17:25.911986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 504/1001] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:26.923984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-081217c1-3b9a-49c8-bae6-3bb25ad75a14 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:26.924943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-081217c1-3b9a-49c8-bae6-3bb25ad75a14 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:26.932839 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-081217c1-3b9a-49c8-bae6-3bb25ad75a14 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:26.933637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-081217c1-3b9a-49c8-bae6-3bb25ad75a14 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:26.935076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-081217c1-3b9a-49c8-bae6-3bb25ad75a14 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:26.935854 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-081217c1-3b9a-49c8-bae6-3bb25ad75a14 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:26.969291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-081217c1-3b9a-49c8-bae6-3bb25ad75a14 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049905 May 24 13:17:26.969850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 498/1002] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:27.981086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c91eae76-fd9d-4393-bc84-cd84cb0fa024 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:27.982002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c91eae76-fd9d-4393-bc84-cd84cb0fa024 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:27.989539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c91eae76-fd9d-4393-bc84-cd84cb0fa024 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:27.990253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c91eae76-fd9d-4393-bc84-cd84cb0fa024 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:27.991031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c91eae76-fd9d-4393-bc84-cd84cb0fa024 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:27.991464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c91eae76-fd9d-4393-bc84-cd84cb0fa024 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:28.020939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c91eae76-fd9d-4393-bc84-cd84cb0fa024 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043870 May 24 13:17:28.021485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 505/1003] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:29.032263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7db373a2-4ce2-4b2d-96ed-dace6a7017de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:29.033632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7db373a2-4ce2-4b2d-96ed-dace6a7017de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:29.040162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7db373a2-4ce2-4b2d-96ed-dace6a7017de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:29.040605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7db373a2-4ce2-4b2d-96ed-dace6a7017de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:29.041355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7db373a2-4ce2-4b2d-96ed-dace6a7017de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:29.041789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7db373a2-4ce2-4b2d-96ed-dace6a7017de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:29.071838 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7db373a2-4ce2-4b2d-96ed-dace6a7017de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043610 May 24 13:17:29.072415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 499/1004] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:30.086693 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8055040c-4173-4147-aa01-0401300c64f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:30.087629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8055040c-4173-4147-aa01-0401300c64f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:30.094364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8055040c-4173-4147-aa01-0401300c64f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:30.094816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8055040c-4173-4147-aa01-0401300c64f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:30.095611 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8055040c-4173-4147-aa01-0401300c64f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:30.096048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8055040c-4173-4147-aa01-0401300c64f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:30.126077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8055040c-4173-4147-aa01-0401300c64f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046940 May 24 13:17:30.127361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 506/1005] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:31.137532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6ad79579-9d38-4bfd-bad5-e62f2d6684de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:31.138484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6ad79579-9d38-4bfd-bad5-e62f2d6684de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:31.145692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ad79579-9d38-4bfd-bad5-e62f2d6684de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:31.146138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ad79579-9d38-4bfd-bad5-e62f2d6684de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:31.146925 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ad79579-9d38-4bfd-bad5-e62f2d6684de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:31.147362 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ad79579-9d38-4bfd-bad5-e62f2d6684de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:31.175639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6ad79579-9d38-4bfd-bad5-e62f2d6684de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042114 May 24 13:17:31.176206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 500/1006] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:32.186714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-53b45b79-ba2d-4d96-a52c-22c732a093a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:32.187662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-53b45b79-ba2d-4d96-a52c-22c732a093a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:32.194230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-53b45b79-ba2d-4d96-a52c-22c732a093a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:32.194711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-53b45b79-ba2d-4d96-a52c-22c732a093a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:32.195472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-53b45b79-ba2d-4d96-a52c-22c732a093a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:32.195913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-53b45b79-ba2d-4d96-a52c-22c732a093a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:32.225952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-53b45b79-ba2d-4d96-a52c-22c732a093a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043208 May 24 13:17:32.226539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 507/1007] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:33.238057 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e8040f8d-8210-4e6d-944d-1392b094f4b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:33.239004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e8040f8d-8210-4e6d-944d-1392b094f4b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:33.245687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8040f8d-8210-4e6d-944d-1392b094f4b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:33.246158 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8040f8d-8210-4e6d-944d-1392b094f4b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:33.246946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8040f8d-8210-4e6d-944d-1392b094f4b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:33.247380 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8040f8d-8210-4e6d-944d-1392b094f4b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:33.275462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e8040f8d-8210-4e6d-944d-1392b094f4b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041945 May 24 13:17:33.276000 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 501/1008] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:34.287365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1b793a43-cfd2-49c9-b1e2-1cf408fad5a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:34.288285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1b793a43-cfd2-49c9-b1e2-1cf408fad5a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:34.294727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1b793a43-cfd2-49c9-b1e2-1cf408fad5a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:34.295173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1b793a43-cfd2-49c9-b1e2-1cf408fad5a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:34.295924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1b793a43-cfd2-49c9-b1e2-1cf408fad5a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:34.296351 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1b793a43-cfd2-49c9-b1e2-1cf408fad5a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:34.325800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1b793a43-cfd2-49c9-b1e2-1cf408fad5a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042330 May 24 13:17:34.326292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 508/1009] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:35.337846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e69343dd-4dc6-406c-ad48-53c76a8d93ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:35.338790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e69343dd-4dc6-406c-ad48-53c76a8d93ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:35.345209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e69343dd-4dc6-406c-ad48-53c76a8d93ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:35.345651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e69343dd-4dc6-406c-ad48-53c76a8d93ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:35.346438 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e69343dd-4dc6-406c-ad48-53c76a8d93ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:35.346871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e69343dd-4dc6-406c-ad48-53c76a8d93ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:35.375739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e69343dd-4dc6-406c-ad48-53c76a8d93ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041835 May 24 13:17:35.376884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 502/1010] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:36.387735 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-835ca97c-3c64-4485-b1f2-8df4b45d23a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:36.388670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-835ca97c-3c64-4485-b1f2-8df4b45d23a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:36.395847 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-835ca97c-3c64-4485-b1f2-8df4b45d23a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:36.396306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-835ca97c-3c64-4485-b1f2-8df4b45d23a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:36.397105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-835ca97c-3c64-4485-b1f2-8df4b45d23a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:36.397548 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-835ca97c-3c64-4485-b1f2-8df4b45d23a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:36.426829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-835ca97c-3c64-4485-b1f2-8df4b45d23a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043025 May 24 13:17:36.427383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 509/1011] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:37.438937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-12ce97ac-0bce-41ed-b8d9-b0a46a02bb77 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:37.439863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-12ce97ac-0bce-41ed-b8d9-b0a46a02bb77 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:37.446390 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-12ce97ac-0bce-41ed-b8d9-b0a46a02bb77 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:37.446846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-12ce97ac-0bce-41ed-b8d9-b0a46a02bb77 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:37.447619 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-12ce97ac-0bce-41ed-b8d9-b0a46a02bb77 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:37.448057 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-12ce97ac-0bce-41ed-b8d9-b0a46a02bb77 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:37.478470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-12ce97ac-0bce-41ed-b8d9-b0a46a02bb77 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043607 May 24 13:17:37.479029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 503/1012] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:38.490468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-60a6e76c-4679-4489-a5b8-010f4346f29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:38.491402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-60a6e76c-4679-4489-a5b8-010f4346f29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:38.497805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-60a6e76c-4679-4489-a5b8-010f4346f29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:38.498256 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-60a6e76c-4679-4489-a5b8-010f4346f29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:38.499084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-60a6e76c-4679-4489-a5b8-010f4346f29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:38.499521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-60a6e76c-4679-4489-a5b8-010f4346f29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:38.528429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-60a6e76c-4679-4489-a5b8-010f4346f29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042855 May 24 13:17:38.528978 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 510/1013] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:39.540647 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0cf4fc61-f025-4cc2-9ec2-52351d53369f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:39.541610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0cf4fc61-f025-4cc2-9ec2-52351d53369f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:39.548231 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0cf4fc61-f025-4cc2-9ec2-52351d53369f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:39.548690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0cf4fc61-f025-4cc2-9ec2-52351d53369f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:39.549456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0cf4fc61-f025-4cc2-9ec2-52351d53369f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:39.549899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0cf4fc61-f025-4cc2-9ec2-52351d53369f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:39.578917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0cf4fc61-f025-4cc2-9ec2-52351d53369f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042336 May 24 13:17:39.580090 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 504/1014] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:40.591165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-737e4b9a-afaf-4443-81fd-5d9d35ada192 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:40.592150 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-737e4b9a-afaf-4443-81fd-5d9d35ada192 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:40.599341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-737e4b9a-afaf-4443-81fd-5d9d35ada192 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:40.599793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-737e4b9a-afaf-4443-81fd-5d9d35ada192 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:40.600556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-737e4b9a-afaf-4443-81fd-5d9d35ada192 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:40.600996 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-737e4b9a-afaf-4443-81fd-5d9d35ada192 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:40.629866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-737e4b9a-afaf-4443-81fd-5d9d35ada192 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042690 May 24 13:17:40.630444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 511/1015] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:41.641054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-03574565-4b38-4617-b834-5aa45c359859 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:41.641999 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-03574565-4b38-4617-b834-5aa45c359859 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:41.649065 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03574565-4b38-4617-b834-5aa45c359859 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:41.649506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03574565-4b38-4617-b834-5aa45c359859 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:41.650260 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03574565-4b38-4617-b834-5aa45c359859 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:41.650711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03574565-4b38-4617-b834-5aa45c359859 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:41.679003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-03574565-4b38-4617-b834-5aa45c359859 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041901 May 24 13:17:41.679485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 505/1016] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:42.690795 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ac3a532e-91af-4c35-b5f3-d3a27624024d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:42.691662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ac3a532e-91af-4c35-b5f3-d3a27624024d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:42.698122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ac3a532e-91af-4c35-b5f3-d3a27624024d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:42.698610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ac3a532e-91af-4c35-b5f3-d3a27624024d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:42.699383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ac3a532e-91af-4c35-b5f3-d3a27624024d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:42.699827 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ac3a532e-91af-4c35-b5f3-d3a27624024d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:42.730339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ac3a532e-91af-4c35-b5f3-d3a27624024d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043646 May 24 13:17:42.730906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 512/1017] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:43.742771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5cb5aec9-357e-4cfa-837e-8644d1f4e3ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:43.743693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5cb5aec9-357e-4cfa-837e-8644d1f4e3ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:43.750160 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cb5aec9-357e-4cfa-837e-8644d1f4e3ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:43.750649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cb5aec9-357e-4cfa-837e-8644d1f4e3ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:43.751406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cb5aec9-357e-4cfa-837e-8644d1f4e3ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:43.751888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cb5aec9-357e-4cfa-837e-8644d1f4e3ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:43.780190 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5cb5aec9-357e-4cfa-837e-8644d1f4e3ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041713 May 24 13:17:43.780732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 506/1018] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:44.792293 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dcda00ed-5e7f-4dcb-ace0-9eafbefb51fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:44.793216 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dcda00ed-5e7f-4dcb-ace0-9eafbefb51fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:44.799616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dcda00ed-5e7f-4dcb-ace0-9eafbefb51fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:44.800061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dcda00ed-5e7f-4dcb-ace0-9eafbefb51fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:44.801369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dcda00ed-5e7f-4dcb-ace0-9eafbefb51fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:44.801804 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dcda00ed-5e7f-4dcb-ace0-9eafbefb51fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:44.830724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dcda00ed-5e7f-4dcb-ace0-9eafbefb51fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042464 May 24 13:17:44.831268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 513/1019] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:45.842458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eb75c661-3ce9-4688-8632-ed0f83d20d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:45.843387 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eb75c661-3ce9-4688-8632-ed0f83d20d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:45.850516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb75c661-3ce9-4688-8632-ed0f83d20d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:45.850965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb75c661-3ce9-4688-8632-ed0f83d20d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:45.851732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb75c661-3ce9-4688-8632-ed0f83d20d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:45.852171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb75c661-3ce9-4688-8632-ed0f83d20d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:45.881495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eb75c661-3ce9-4688-8632-ed0f83d20d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043152 May 24 13:17:45.882059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 507/1020] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:46.893093 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b58e2cde-dc1e-4d75-913d-94862e058cdd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:46.894014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b58e2cde-dc1e-4d75-913d-94862e058cdd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:46.900144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b58e2cde-dc1e-4d75-913d-94862e058cdd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:46.900592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b58e2cde-dc1e-4d75-913d-94862e058cdd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:46.901352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b58e2cde-dc1e-4d75-913d-94862e058cdd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:46.901793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b58e2cde-dc1e-4d75-913d-94862e058cdd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:46.931061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b58e2cde-dc1e-4d75-913d-94862e058cdd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042051 May 24 13:17:46.931596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 514/1021] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:47.943335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b849417-688c-46be-b205-fe5f6ca72d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:47.944255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b849417-688c-46be-b205-fe5f6ca72d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:47.950253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b849417-688c-46be-b205-fe5f6ca72d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:47.950812 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b849417-688c-46be-b205-fe5f6ca72d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:47.951604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b849417-688c-46be-b205-fe5f6ca72d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:47.952046 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b849417-688c-46be-b205-fe5f6ca72d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:47.980345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b849417-688c-46be-b205-fe5f6ca72d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041817 May 24 13:17:47.980890 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 508/1022] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:48.992114 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5cc085fb-9254-43f9-9147-f36090b55d51 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:48.993040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5cc085fb-9254-43f9-9147-f36090b55d51 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:48.995364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:17:49.000697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5cc085fb-9254-43f9-9147-f36090b55d51 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:49.001149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5cc085fb-9254-43f9-9147-f36090b55d51 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:49.001909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5cc085fb-9254-43f9-9147-f36090b55d51 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:49.002377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5cc085fb-9254-43f9-9147-f36090b55d51 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:49.006448 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:17:49.034087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5cc085fb-9254-43f9-9147-f36090b55d51 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046111 May 24 13:17:49.034710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 515/1023] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:50.045679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-117761dd-40d4-449f-b13f-7a89675d36f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:50.046633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-117761dd-40d4-449f-b13f-7a89675d36f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:50.049052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:17:50.055034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117761dd-40d4-449f-b13f-7a89675d36f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:50.055482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117761dd-40d4-449f-b13f-7a89675d36f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:50.056251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117761dd-40d4-449f-b13f-7a89675d36f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:50.056691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117761dd-40d4-449f-b13f-7a89675d36f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:50.060451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:17:50.086704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-117761dd-40d4-449f-b13f-7a89675d36f1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044955 May 24 13:17:50.087258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 509/1024] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:51.098465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-41755e1c-ce1a-43a1-b8c0-a7ea466eb2d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:51.099404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-41755e1c-ce1a-43a1-b8c0-a7ea466eb2d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:51.105961 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-41755e1c-ce1a-43a1-b8c0-a7ea466eb2d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:51.106456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-41755e1c-ce1a-43a1-b8c0-a7ea466eb2d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:51.107221 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-41755e1c-ce1a-43a1-b8c0-a7ea466eb2d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:51.107658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-41755e1c-ce1a-43a1-b8c0-a7ea466eb2d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:51.137454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-41755e1c-ce1a-43a1-b8c0-a7ea466eb2d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043097 May 24 13:17:51.138003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 516/1025] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:52.151859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c094032a-180b-4a14-a42c-c1c5739d2b64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:52.152824 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c094032a-180b-4a14-a42c-c1c5739d2b64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:52.159609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c094032a-180b-4a14-a42c-c1c5739d2b64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:52.160061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c094032a-180b-4a14-a42c-c1c5739d2b64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:52.160829 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c094032a-180b-4a14-a42c-c1c5739d2b64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:52.161269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c094032a-180b-4a14-a42c-c1c5739d2b64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:52.189684 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c094032a-180b-4a14-a42c-c1c5739d2b64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041888 May 24 13:17:52.190236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 510/1026] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:17:53.201808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4c874afa-af9d-436a-ad66-7d1d1374b848 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:53.202763 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4c874afa-af9d-436a-ad66-7d1d1374b848 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:53.209796 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4c874afa-af9d-436a-ad66-7d1d1374b848 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:53.210243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4c874afa-af9d-436a-ad66-7d1d1374b848 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:53.211029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4c874afa-af9d-436a-ad66-7d1d1374b848 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:53.211469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4c874afa-af9d-436a-ad66-7d1d1374b848 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:53.240735 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4c874afa-af9d-436a-ad66-7d1d1374b848 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042934 May 24 13:17:53.241283 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 517/1027] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:54.252362 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-01c19014-e2ca-4e7c-8d7f-86491bf005e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:54.253289 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-01c19014-e2ca-4e7c-8d7f-86491bf005e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:54.260415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-01c19014-e2ca-4e7c-8d7f-86491bf005e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:54.260866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-01c19014-e2ca-4e7c-8d7f-86491bf005e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:54.261634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-01c19014-e2ca-4e7c-8d7f-86491bf005e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:54.262069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-01c19014-e2ca-4e7c-8d7f-86491bf005e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:54.293754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-01c19014-e2ca-4e7c-8d7f-86491bf005e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045341 May 24 13:17:54.294329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 511/1028] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:55.305065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-30bd0af0-a667-434a-a830-e1d1ff6ff76e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:55.305984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-30bd0af0-a667-434a-a830-e1d1ff6ff76e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:55.312893 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30bd0af0-a667-434a-a830-e1d1ff6ff76e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:55.313335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30bd0af0-a667-434a-a830-e1d1ff6ff76e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:55.314090 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30bd0af0-a667-434a-a830-e1d1ff6ff76e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:55.314547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30bd0af0-a667-434a-a830-e1d1ff6ff76e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:55.343815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-30bd0af0-a667-434a-a830-e1d1ff6ff76e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042699 May 24 13:17:55.344361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 518/1029] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:56.355425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7ed73f93-9d6b-4516-8a85-73802b4cd94b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:56.356374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7ed73f93-9d6b-4516-8a85-73802b4cd94b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:56.362993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ed73f93-9d6b-4516-8a85-73802b4cd94b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:56.363452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ed73f93-9d6b-4516-8a85-73802b4cd94b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:56.364225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ed73f93-9d6b-4516-8a85-73802b4cd94b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:56.364927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ed73f93-9d6b-4516-8a85-73802b4cd94b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:56.395785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7ed73f93-9d6b-4516-8a85-73802b4cd94b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044280 May 24 13:17:56.396345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 512/1030] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:57.408057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2ea55699-5049-41be-83e8-72ee26be3992 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:57.409009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2ea55699-5049-41be-83e8-72ee26be3992 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:57.416041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ea55699-5049-41be-83e8-72ee26be3992 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:57.416487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ea55699-5049-41be-83e8-72ee26be3992 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:57.417244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ea55699-5049-41be-83e8-72ee26be3992 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:57.417681 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ea55699-5049-41be-83e8-72ee26be3992 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:57.448144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2ea55699-5049-41be-83e8-72ee26be3992 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044042 May 24 13:17:57.448695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 519/1031] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:17:58.459798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-63d672ca-d552-43a3-888c-7fe82172d419 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:58.460723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-63d672ca-d552-43a3-888c-7fe82172d419 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:58.467290 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63d672ca-d552-43a3-888c-7fe82172d419 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:58.467743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63d672ca-d552-43a3-888c-7fe82172d419 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:58.468505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63d672ca-d552-43a3-888c-7fe82172d419 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:58.468941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63d672ca-d552-43a3-888c-7fe82172d419 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:58.499468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-63d672ca-d552-43a3-888c-7fe82172d419 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043676 May 24 13:17:58.500020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 513/1032] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:58 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:17:59.512036 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-24856883-d836-478b-bae0-37e9a3770b94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:17:59.512966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-24856883-d836-478b-bae0-37e9a3770b94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:17:59.519490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24856883-d836-478b-bae0-37e9a3770b94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:59.519944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24856883-d836-478b-bae0-37e9a3770b94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:59.520749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24856883-d836-478b-bae0-37e9a3770b94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:17:59.521189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24856883-d836-478b-bae0-37e9a3770b94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:17:59.550508 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-24856883-d836-478b-bae0-37e9a3770b94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042982 May 24 13:17:59.551058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 520/1033] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:17:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:00.561475 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c5ced812-05e7-4f2f-8158-8fae9396ef32 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:00.562431 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c5ced812-05e7-4f2f-8158-8fae9396ef32 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:00.569075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5ced812-05e7-4f2f-8158-8fae9396ef32 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:00.569530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5ced812-05e7-4f2f-8158-8fae9396ef32 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:00.570322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5ced812-05e7-4f2f-8158-8fae9396ef32 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:00.570766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5ced812-05e7-4f2f-8158-8fae9396ef32 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:00.599869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c5ced812-05e7-4f2f-8158-8fae9396ef32 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042434 May 24 13:18:00.600420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 514/1034] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:01.611422 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fa04fa3b-6c50-416b-ad07-298d147c27ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:01.612357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fa04fa3b-6c50-416b-ad07-298d147c27ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:01.620252 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fa04fa3b-6c50-416b-ad07-298d147c27ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:01.620712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fa04fa3b-6c50-416b-ad07-298d147c27ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:01.621485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fa04fa3b-6c50-416b-ad07-298d147c27ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:01.621931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fa04fa3b-6c50-416b-ad07-298d147c27ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:01.652368 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fa04fa3b-6c50-416b-ad07-298d147c27ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044899 May 24 13:18:01.652922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 521/1035] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:02.663989 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c64ebc74-8e9e-4f68-848a-289eb897d40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:02.665335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c64ebc74-8e9e-4f68-848a-289eb897d40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:02.671860 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c64ebc74-8e9e-4f68-848a-289eb897d40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:02.672320 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c64ebc74-8e9e-4f68-848a-289eb897d40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:02.673078 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c64ebc74-8e9e-4f68-848a-289eb897d40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:02.673553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c64ebc74-8e9e-4f68-848a-289eb897d40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:02.702853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c64ebc74-8e9e-4f68-848a-289eb897d40f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042928 May 24 13:18:02.703403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 515/1036] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:03.715053 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-45643814-fc46-4702-b66e-5a264e69e8d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:03.715903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-45643814-fc46-4702-b66e-5a264e69e8d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:03.722405 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-45643814-fc46-4702-b66e-5a264e69e8d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:03.722863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-45643814-fc46-4702-b66e-5a264e69e8d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:03.723625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-45643814-fc46-4702-b66e-5a264e69e8d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:03.724062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-45643814-fc46-4702-b66e-5a264e69e8d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:03.753507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-45643814-fc46-4702-b66e-5a264e69e8d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043056 May 24 13:18:03.754055 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 522/1037] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:04.766217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9fddbd84-8ea9-40aa-b1ff-0413d814faf8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:04.767080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9fddbd84-8ea9-40aa-b1ff-0413d814faf8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:04.773729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fddbd84-8ea9-40aa-b1ff-0413d814faf8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:04.774720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fddbd84-8ea9-40aa-b1ff-0413d814faf8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:04.776818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fddbd84-8ea9-40aa-b1ff-0413d814faf8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:04.776818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fddbd84-8ea9-40aa-b1ff-0413d814faf8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:04.805997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9fddbd84-8ea9-40aa-b1ff-0413d814faf8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044505 May 24 13:18:04.806568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 516/1038] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:05.817354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a0654bbb-f94e-4eff-863e-430b8286a818 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:05.818338 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a0654bbb-f94e-4eff-863e-430b8286a818 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:05.824842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0654bbb-f94e-4eff-863e-430b8286a818 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:05.825292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0654bbb-f94e-4eff-863e-430b8286a818 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:05.826055 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0654bbb-f94e-4eff-863e-430b8286a818 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:05.826529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0654bbb-f94e-4eff-863e-430b8286a818 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:05.856165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a0654bbb-f94e-4eff-863e-430b8286a818 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042784 May 24 13:18:05.856712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 523/1039] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:06.867737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-efb7da42-a4fc-4e39-9b61-2525514b229f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:06.868668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-efb7da42-a4fc-4e39-9b61-2525514b229f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:06.875269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efb7da42-a4fc-4e39-9b61-2525514b229f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:06.875725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efb7da42-a4fc-4e39-9b61-2525514b229f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:06.876493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efb7da42-a4fc-4e39-9b61-2525514b229f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:06.876932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efb7da42-a4fc-4e39-9b61-2525514b229f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:06.907217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-efb7da42-a4fc-4e39-9b61-2525514b229f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043798 May 24 13:18:06.907764 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 517/1040] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:07.918598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4491c6ec-f038-419d-aef2-d3f95ae082d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:07.919520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4491c6ec-f038-419d-aef2-d3f95ae082d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:07.925865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4491c6ec-f038-419d-aef2-d3f95ae082d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:07.926477 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4491c6ec-f038-419d-aef2-d3f95ae082d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:07.927234 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4491c6ec-f038-419d-aef2-d3f95ae082d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:07.927664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4491c6ec-f038-419d-aef2-d3f95ae082d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:07.958415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4491c6ec-f038-419d-aef2-d3f95ae082d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043847 May 24 13:18:07.958968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 524/1041] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:08.970083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3ca4e06e-54ac-412b-91e5-c3ee3e54472d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:08.971041 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3ca4e06e-54ac-412b-91e5-c3ee3e54472d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:08.978076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ca4e06e-54ac-412b-91e5-c3ee3e54472d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:08.978546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ca4e06e-54ac-412b-91e5-c3ee3e54472d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:08.979432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ca4e06e-54ac-412b-91e5-c3ee3e54472d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:08.979864 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ca4e06e-54ac-412b-91e5-c3ee3e54472d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:09.010367 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3ca4e06e-54ac-412b-91e5-c3ee3e54472d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044263 May 24 13:18:09.010917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 518/1042] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:10.021859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-988fedf7-1c48-40db-8ff2-6039f58c0e75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:10.022807 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-988fedf7-1c48-40db-8ff2-6039f58c0e75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:10.029278 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-988fedf7-1c48-40db-8ff2-6039f58c0e75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:10.029724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-988fedf7-1c48-40db-8ff2-6039f58c0e75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:10.030582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-988fedf7-1c48-40db-8ff2-6039f58c0e75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:10.031019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-988fedf7-1c48-40db-8ff2-6039f58c0e75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:10.060596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-988fedf7-1c48-40db-8ff2-6039f58c0e75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042676 May 24 13:18:10.061134 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 525/1043] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:11.072366 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-38daf4c9-fe30-44fa-b8eb-80b6e9c10398 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:11.073300 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-38daf4c9-fe30-44fa-b8eb-80b6e9c10398 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:11.080098 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38daf4c9-fe30-44fa-b8eb-80b6e9c10398 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:11.080555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38daf4c9-fe30-44fa-b8eb-80b6e9c10398 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:11.081328 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38daf4c9-fe30-44fa-b8eb-80b6e9c10398 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:11.081770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38daf4c9-fe30-44fa-b8eb-80b6e9c10398 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:11.112111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-38daf4c9-fe30-44fa-b8eb-80b6e9c10398 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043789 May 24 13:18:11.112681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 519/1044] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:12.124428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8b4e3c13-e617-41fc-8ea9-ac6c4c273f59 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:12.125347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8b4e3c13-e617-41fc-8ea9-ac6c4c273f59 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:12.131894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b4e3c13-e617-41fc-8ea9-ac6c4c273f59 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:12.132340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b4e3c13-e617-41fc-8ea9-ac6c4c273f59 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:12.133091 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b4e3c13-e617-41fc-8ea9-ac6c4c273f59 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:12.133524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b4e3c13-e617-41fc-8ea9-ac6c4c273f59 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:12.161588 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8b4e3c13-e617-41fc-8ea9-ac6c4c273f59 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041129 May 24 13:18:12.162123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 526/1045] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:13.173309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-96994ca1-addc-4c3a-9f7b-5b8e832eee85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:13.174232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-96994ca1-addc-4c3a-9f7b-5b8e832eee85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:13.181283 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96994ca1-addc-4c3a-9f7b-5b8e832eee85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:13.181733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96994ca1-addc-4c3a-9f7b-5b8e832eee85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:13.182542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96994ca1-addc-4c3a-9f7b-5b8e832eee85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:13.182979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96994ca1-addc-4c3a-9f7b-5b8e832eee85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:13.212510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-96994ca1-addc-4c3a-9f7b-5b8e832eee85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043232 May 24 13:18:13.213052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 520/1046] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:18:14.224164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fcda1ea0-cdd0-419d-b1d3-537d9435f1af tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:14.225021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fcda1ea0-cdd0-419d-b1d3-537d9435f1af tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:14.231574 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcda1ea0-cdd0-419d-b1d3-537d9435f1af tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:14.232022 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcda1ea0-cdd0-419d-b1d3-537d9435f1af tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:14.232783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcda1ea0-cdd0-419d-b1d3-537d9435f1af tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:14.233219 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcda1ea0-cdd0-419d-b1d3-537d9435f1af tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:14.263576 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fcda1ea0-cdd0-419d-b1d3-537d9435f1af tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043448 May 24 13:18:14.264122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 527/1047] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:15.275724 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7d41e223-b78e-4d5c-b3fc-6a1cdf2c4473 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:15.276679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7d41e223-b78e-4d5c-b3fc-6a1cdf2c4473 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:15.283222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d41e223-b78e-4d5c-b3fc-6a1cdf2c4473 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:15.283677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d41e223-b78e-4d5c-b3fc-6a1cdf2c4473 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:15.284447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d41e223-b78e-4d5c-b3fc-6a1cdf2c4473 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:15.284887 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d41e223-b78e-4d5c-b3fc-6a1cdf2c4473 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:15.313363 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7d41e223-b78e-4d5c-b3fc-6a1cdf2c4473 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042217 May 24 13:18:15.313911 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 521/1048] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:16.324810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f5aa0ba1-56c9-4e5b-a326-4d2b3836291b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:16.325740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f5aa0ba1-56c9-4e5b-a326-4d2b3836291b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:16.332243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f5aa0ba1-56c9-4e5b-a326-4d2b3836291b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:16.332716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f5aa0ba1-56c9-4e5b-a326-4d2b3836291b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:16.333473 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f5aa0ba1-56c9-4e5b-a326-4d2b3836291b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:16.333916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f5aa0ba1-56c9-4e5b-a326-4d2b3836291b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:16.364188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f5aa0ba1-56c9-4e5b-a326-4d2b3836291b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043436 May 24 13:18:16.364924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 528/1049] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:17.376217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-389becc6-4651-4680-890c-6da93d6c22a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:17.377172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-389becc6-4651-4680-890c-6da93d6c22a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:17.384176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-389becc6-4651-4680-890c-6da93d6c22a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:17.384626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-389becc6-4651-4680-890c-6da93d6c22a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:17.385397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-389becc6-4651-4680-890c-6da93d6c22a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:17.385834 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-389becc6-4651-4680-890c-6da93d6c22a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:17.415635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-389becc6-4651-4680-890c-6da93d6c22a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043411 May 24 13:18:17.416193 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 522/1050] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:18.427179 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7cbb6629-4377-408c-9b73-68a51eb5f0d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:18.428149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7cbb6629-4377-408c-9b73-68a51eb5f0d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:18.435271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cbb6629-4377-408c-9b73-68a51eb5f0d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:18.435725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cbb6629-4377-408c-9b73-68a51eb5f0d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:18.436487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cbb6629-4377-408c-9b73-68a51eb5f0d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:18.436927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7cbb6629-4377-408c-9b73-68a51eb5f0d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:18.465704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7cbb6629-4377-408c-9b73-68a51eb5f0d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042499 May 24 13:18:18.466249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 529/1051] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:19.477923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f5b3f2d7-9cb4-4fad-a9f6-9eb3d94be779 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:19.478887 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f5b3f2d7-9cb4-4fad-a9f6-9eb3d94be779 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:19.485342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5b3f2d7-9cb4-4fad-a9f6-9eb3d94be779 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:19.485796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5b3f2d7-9cb4-4fad-a9f6-9eb3d94be779 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:19.486592 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5b3f2d7-9cb4-4fad-a9f6-9eb3d94be779 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:19.487033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5b3f2d7-9cb4-4fad-a9f6-9eb3d94be779 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:19.515901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f5b3f2d7-9cb4-4fad-a9f6-9eb3d94be779 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042607 May 24 13:18:19.516456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 523/1052] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:20.527467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-42c403a9-513e-4ac6-9d85-7bc25f4e1dd4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:20.528387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-42c403a9-513e-4ac6-9d85-7bc25f4e1dd4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:20.530697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:18:20.536212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-42c403a9-513e-4ac6-9d85-7bc25f4e1dd4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:20.536801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-42c403a9-513e-4ac6-9d85-7bc25f4e1dd4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:20.537615 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-42c403a9-513e-4ac6-9d85-7bc25f4e1dd4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:20.538049 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-42c403a9-513e-4ac6-9d85-7bc25f4e1dd4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:20.541069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:18:20.569564 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-42c403a9-513e-4ac6-9d85-7bc25f4e1dd4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046222 May 24 13:18:20.570183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 530/1053] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:20.910197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:18:20.910728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:18:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:18:21.581656 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-972b22dc-6d7c-4376-b540-b35f791a56c6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:21.583555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-972b22dc-6d7c-4376-b540-b35f791a56c6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:21.589309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:18:21.593127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-972b22dc-6d7c-4376-b540-b35f791a56c6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:21.593587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-972b22dc-6d7c-4376-b540-b35f791a56c6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:21.594444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-972b22dc-6d7c-4376-b540-b35f791a56c6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:21.594884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-972b22dc-6d7c-4376-b540-b35f791a56c6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:21.599200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:18:21.626156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-972b22dc-6d7c-4376-b540-b35f791a56c6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048509 May 24 13:18:21.626731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 524/1054] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:22.637699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-057abeb2-3fa8-473c-8a1c-0c6dc23b6cca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:22.638657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-057abeb2-3fa8-473c-8a1c-0c6dc23b6cca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:22.645393 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-057abeb2-3fa8-473c-8a1c-0c6dc23b6cca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:22.645797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-057abeb2-3fa8-473c-8a1c-0c6dc23b6cca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:22.646585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-057abeb2-3fa8-473c-8a1c-0c6dc23b6cca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:22.647026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-057abeb2-3fa8-473c-8a1c-0c6dc23b6cca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:22.675940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-057abeb2-3fa8-473c-8a1c-0c6dc23b6cca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042176 May 24 13:18:22.676484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 531/1055] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:23.688092 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6643b03a-22e2-43ef-b58d-b6b581359b05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:23.689079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6643b03a-22e2-43ef-b58d-b6b581359b05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:23.695923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6643b03a-22e2-43ef-b58d-b6b581359b05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:23.696369 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6643b03a-22e2-43ef-b58d-b6b581359b05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:23.697124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6643b03a-22e2-43ef-b58d-b6b581359b05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:23.697558 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6643b03a-22e2-43ef-b58d-b6b581359b05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:23.726703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6643b03a-22e2-43ef-b58d-b6b581359b05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042553 May 24 13:18:23.727245 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 525/1056] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:24.738369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2d442fc8-df0e-4097-8019-cafe95078ef2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:24.739476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2d442fc8-df0e-4097-8019-cafe95078ef2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:24.745923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2d442fc8-df0e-4097-8019-cafe95078ef2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:24.746409 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2d442fc8-df0e-4097-8019-cafe95078ef2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:24.747173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2d442fc8-df0e-4097-8019-cafe95078ef2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:24.747631 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2d442fc8-df0e-4097-8019-cafe95078ef2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:24.776611 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2d442fc8-df0e-4097-8019-cafe95078ef2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042348 May 24 13:18:24.777153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 532/1057] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:25.788183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-33420003-cbb9-434d-904e-82cc89490ecf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:25.789018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-33420003-cbb9-434d-904e-82cc89490ecf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:25.795622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33420003-cbb9-434d-904e-82cc89490ecf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:25.796067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33420003-cbb9-434d-904e-82cc89490ecf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:25.796821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33420003-cbb9-434d-904e-82cc89490ecf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:25.797249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33420003-cbb9-434d-904e-82cc89490ecf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:25.826884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-33420003-cbb9-434d-904e-82cc89490ecf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042687 May 24 13:18:25.827449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 526/1058] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:26.839286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-080d10a1-b84e-4838-9f69-0999a2ff205b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:26.840260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-080d10a1-b84e-4838-9f69-0999a2ff205b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:26.846789 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-080d10a1-b84e-4838-9f69-0999a2ff205b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:26.847243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-080d10a1-b84e-4838-9f69-0999a2ff205b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:26.848009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-080d10a1-b84e-4838-9f69-0999a2ff205b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:26.848455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-080d10a1-b84e-4838-9f69-0999a2ff205b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:26.885711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-080d10a1-b84e-4838-9f69-0999a2ff205b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050869 May 24 13:18:26.886271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 533/1059] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:27.897474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-005c17e9-3d8a-4a1e-b9db-171d943b82c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:27.898436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-005c17e9-3d8a-4a1e-b9db-171d943b82c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:27.905361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-005c17e9-3d8a-4a1e-b9db-171d943b82c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:27.905812 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-005c17e9-3d8a-4a1e-b9db-171d943b82c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:27.906627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-005c17e9-3d8a-4a1e-b9db-171d943b82c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:27.907071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-005c17e9-3d8a-4a1e-b9db-171d943b82c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:27.938270 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-005c17e9-3d8a-4a1e-b9db-171d943b82c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044807 May 24 13:18:27.938847 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 527/1060] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:28.950982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a6e526c6-2039-4264-9a65-c5835a3a7cf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:28.951864 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a6e526c6-2039-4264-9a65-c5835a3a7cf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:28.958415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6e526c6-2039-4264-9a65-c5835a3a7cf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:28.958873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6e526c6-2039-4264-9a65-c5835a3a7cf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:28.959642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6e526c6-2039-4264-9a65-c5835a3a7cf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:28.960085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6e526c6-2039-4264-9a65-c5835a3a7cf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:28.988798 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a6e526c6-2039-4264-9a65-c5835a3a7cf5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041852 May 24 13:18:28.989622 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 534/1061] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:30.001042 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-313a8598-a401-472b-b543-166a4e176913 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:30.002006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-313a8598-a401-472b-b543-166a4e176913 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:30.009198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-313a8598-a401-472b-b543-166a4e176913 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:30.009651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-313a8598-a401-472b-b543-166a4e176913 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:30.010449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-313a8598-a401-472b-b543-166a4e176913 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:30.010896 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-313a8598-a401-472b-b543-166a4e176913 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:30.040584 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-313a8598-a401-472b-b543-166a4e176913 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043453 May 24 13:18:30.041063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 528/1062] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:31.052077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5e83363f-f71c-415e-a5d5-adea711560b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:31.053006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5e83363f-f71c-415e-a5d5-adea711560b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:31.059521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e83363f-f71c-415e-a5d5-adea711560b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:31.059976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e83363f-f71c-415e-a5d5-adea711560b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:31.060742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e83363f-f71c-415e-a5d5-adea711560b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:31.061183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e83363f-f71c-415e-a5d5-adea711560b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:31.090720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5e83363f-f71c-415e-a5d5-adea711560b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042541 May 24 13:18:31.091243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 535/1063] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:32.102893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-47294ec4-409e-4e67-96d7-d772d5778ffa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:32.103851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-47294ec4-409e-4e67-96d7-d772d5778ffa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:32.110516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47294ec4-409e-4e67-96d7-d772d5778ffa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:32.110966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47294ec4-409e-4e67-96d7-d772d5778ffa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:32.111721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47294ec4-409e-4e67-96d7-d772d5778ffa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:32.112149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47294ec4-409e-4e67-96d7-d772d5778ffa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:32.140454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-47294ec4-409e-4e67-96d7-d772d5778ffa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042209 May 24 13:18:32.140988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 529/1064] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:33.151784 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-be71d753-ef71-4e76-a5d2-7fd64f46c97e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:33.152637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-be71d753-ef71-4e76-a5d2-7fd64f46c97e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:33.159286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-be71d753-ef71-4e76-a5d2-7fd64f46c97e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:33.159743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-be71d753-ef71-4e76-a5d2-7fd64f46c97e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:33.160507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-be71d753-ef71-4e76-a5d2-7fd64f46c97e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:33.160951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-be71d753-ef71-4e76-a5d2-7fd64f46c97e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:33.191170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-be71d753-ef71-4e76-a5d2-7fd64f46c97e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043442 May 24 13:18:33.191719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 536/1065] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:34.202201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7ead14f0-ca99-4220-af16-2d10f10f26d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:34.203175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7ead14f0-ca99-4220-af16-2d10f10f26d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:34.209606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ead14f0-ca99-4220-af16-2d10f10f26d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:34.210052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ead14f0-ca99-4220-af16-2d10f10f26d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:34.210923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ead14f0-ca99-4220-af16-2d10f10f26d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:34.211354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ead14f0-ca99-4220-af16-2d10f10f26d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:34.242067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7ead14f0-ca99-4220-af16-2d10f10f26d6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043541 May 24 13:18:34.242568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 530/1066] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:35.253541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9b7364c5-a938-4cf2-9cda-4462b8251345 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:35.254521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9b7364c5-a938-4cf2-9cda-4462b8251345 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:35.261014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b7364c5-a938-4cf2-9cda-4462b8251345 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:35.261469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b7364c5-a938-4cf2-9cda-4462b8251345 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:35.262268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b7364c5-a938-4cf2-9cda-4462b8251345 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:35.262734 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b7364c5-a938-4cf2-9cda-4462b8251345 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:35.292656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9b7364c5-a938-4cf2-9cda-4462b8251345 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043090 May 24 13:18:35.293203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 537/1067] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:36.304806 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8e79634e-7255-46ee-85ac-7e24ecfcd8ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:36.305728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8e79634e-7255-46ee-85ac-7e24ecfcd8ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:36.312270 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79634e-7255-46ee-85ac-7e24ecfcd8ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:36.312716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79634e-7255-46ee-85ac-7e24ecfcd8ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:36.313752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79634e-7255-46ee-85ac-7e24ecfcd8ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:36.314189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79634e-7255-46ee-85ac-7e24ecfcd8ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:36.343653 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8e79634e-7255-46ee-85ac-7e24ecfcd8ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043319 May 24 13:18:36.344215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 531/1068] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:37.354434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c739a00c-d653-4722-8627-9714d000b147 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:37.355362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c739a00c-d653-4722-8627-9714d000b147 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:37.361864 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c739a00c-d653-4722-8627-9714d000b147 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:37.362343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c739a00c-d653-4722-8627-9714d000b147 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:37.363107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c739a00c-d653-4722-8627-9714d000b147 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:37.363550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c739a00c-d653-4722-8627-9714d000b147 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:37.393437 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c739a00c-d653-4722-8627-9714d000b147 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042969 May 24 13:18:37.393991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 538/1069] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:38.405197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9a43b580-dbc3-4810-b990-96e5f2af2bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:38.406307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9a43b580-dbc3-4810-b990-96e5f2af2bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:38.412966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a43b580-dbc3-4810-b990-96e5f2af2bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:38.413469 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a43b580-dbc3-4810-b990-96e5f2af2bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:38.414229 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a43b580-dbc3-4810-b990-96e5f2af2bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:38.414694 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a43b580-dbc3-4810-b990-96e5f2af2bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:38.443238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9a43b580-dbc3-4810-b990-96e5f2af2bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042122 May 24 13:18:38.443772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 532/1070] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:39.460541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-487fd80e-0599-4e71-bae1-9b8830ef59ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:39.461468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-487fd80e-0599-4e71-bae1-9b8830ef59ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:39.467979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-487fd80e-0599-4e71-bae1-9b8830ef59ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:39.468433 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-487fd80e-0599-4e71-bae1-9b8830ef59ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:39.469195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-487fd80e-0599-4e71-bae1-9b8830ef59ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:39.469630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-487fd80e-0599-4e71-bae1-9b8830ef59ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:39.499251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-487fd80e-0599-4e71-bae1-9b8830ef59ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042681 May 24 13:18:39.499808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 539/1071] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:39.987520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:18:39.987749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:18:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:18:40.510963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4c71b887-addc-46aa-97f0-cac084e2a76a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:40.511887 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4c71b887-addc-46aa-97f0-cac084e2a76a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:40.518443 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c71b887-addc-46aa-97f0-cac084e2a76a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:40.518904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c71b887-addc-46aa-97f0-cac084e2a76a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:40.519670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c71b887-addc-46aa-97f0-cac084e2a76a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:40.520105 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c71b887-addc-46aa-97f0-cac084e2a76a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:40.549893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4c71b887-addc-46aa-97f0-cac084e2a76a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043005 May 24 13:18:40.550469 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 533/1072] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:41.561346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-acc949c5-b84a-4e8e-ac5e-7738b1f4737d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:41.562296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-acc949c5-b84a-4e8e-ac5e-7738b1f4737d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:41.568896 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acc949c5-b84a-4e8e-ac5e-7738b1f4737d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:41.569874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acc949c5-b84a-4e8e-ac5e-7738b1f4737d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:41.570664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acc949c5-b84a-4e8e-ac5e-7738b1f4737d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:41.571103 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-acc949c5-b84a-4e8e-ac5e-7738b1f4737d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:41.604950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-acc949c5-b84a-4e8e-ac5e-7738b1f4737d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047540 May 24 13:18:41.605493 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 540/1073] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:42.616763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ffc91aff-0048-4a19-9ebc-f9bff7fc7dbc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:42.617678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ffc91aff-0048-4a19-9ebc-f9bff7fc7dbc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:42.624691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ffc91aff-0048-4a19-9ebc-f9bff7fc7dbc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:42.625137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ffc91aff-0048-4a19-9ebc-f9bff7fc7dbc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:42.625895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ffc91aff-0048-4a19-9ebc-f9bff7fc7dbc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:42.626351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ffc91aff-0048-4a19-9ebc-f9bff7fc7dbc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:42.655703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ffc91aff-0048-4a19-9ebc-f9bff7fc7dbc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043092 May 24 13:18:42.656249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 534/1074] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:43.668444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f62eaea8-9d6c-421b-b476-8d4039b164e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:43.669326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f62eaea8-9d6c-421b-b476-8d4039b164e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:43.675949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f62eaea8-9d6c-421b-b476-8d4039b164e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:43.676399 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f62eaea8-9d6c-421b-b476-8d4039b164e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:43.677150 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f62eaea8-9d6c-421b-b476-8d4039b164e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:43.677583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f62eaea8-9d6c-421b-b476-8d4039b164e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:43.691700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:18:43.691905 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:18:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments (ip 10.222.0.45) !!! May 24 13:18:43.710564 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f62eaea8-9d6c-421b-b476-8d4039b164e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046147 May 24 13:18:43.711115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 541/1075] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:44.722203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7538ae19-7223-43f9-93b1-c3500bce4205 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:44.723067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7538ae19-7223-43f9-93b1-c3500bce4205 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:44.729548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7538ae19-7223-43f9-93b1-c3500bce4205 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:44.729991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7538ae19-7223-43f9-93b1-c3500bce4205 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:44.730774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7538ae19-7223-43f9-93b1-c3500bce4205 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:44.731206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7538ae19-7223-43f9-93b1-c3500bce4205 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:44.760764 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7538ae19-7223-43f9-93b1-c3500bce4205 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042600 May 24 13:18:44.761301 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 535/1076] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:45.772382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3646b215-f18e-4f61-b3e9-9ee0d4884013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:45.773334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3646b215-f18e-4f61-b3e9-9ee0d4884013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:45.780484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3646b215-f18e-4f61-b3e9-9ee0d4884013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:45.780935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3646b215-f18e-4f61-b3e9-9ee0d4884013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:45.781695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3646b215-f18e-4f61-b3e9-9ee0d4884013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:45.782133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3646b215-f18e-4f61-b3e9-9ee0d4884013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:45.810338 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3646b215-f18e-4f61-b3e9-9ee0d4884013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042006 May 24 13:18:45.810879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 542/1077] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:46.821087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e9911e85-ffa6-4725-b298-7da84ccb9dc4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:46.822013 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e9911e85-ffa6-4725-b298-7da84ccb9dc4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:46.828513 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9911e85-ffa6-4725-b298-7da84ccb9dc4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:46.828976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9911e85-ffa6-4725-b298-7da84ccb9dc4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:46.829741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9911e85-ffa6-4725-b298-7da84ccb9dc4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:46.830178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9911e85-ffa6-4725-b298-7da84ccb9dc4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:46.859280 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e9911e85-ffa6-4725-b298-7da84ccb9dc4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042220 May 24 13:18:46.859826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 536/1078] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:47.870998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f59cbfec-5324-4390-8aed-1539a953e2cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:47.871921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f59cbfec-5324-4390-8aed-1539a953e2cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:47.877918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f59cbfec-5324-4390-8aed-1539a953e2cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:47.878400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f59cbfec-5324-4390-8aed-1539a953e2cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:47.879163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f59cbfec-5324-4390-8aed-1539a953e2cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:47.879595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f59cbfec-5324-4390-8aed-1539a953e2cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:47.908511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f59cbfec-5324-4390-8aed-1539a953e2cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041618 May 24 13:18:47.909049 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 543/1079] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:48.919994 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dfa9da35-02aa-4f5f-ac5c-7d87cddeddc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:48.920930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dfa9da35-02aa-4f5f-ac5c-7d87cddeddc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:48.927212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfa9da35-02aa-4f5f-ac5c-7d87cddeddc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:48.927670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfa9da35-02aa-4f5f-ac5c-7d87cddeddc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:48.928434 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfa9da35-02aa-4f5f-ac5c-7d87cddeddc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:48.928873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfa9da35-02aa-4f5f-ac5c-7d87cddeddc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:48.961211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dfa9da35-02aa-4f5f-ac5c-7d87cddeddc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045125 May 24 13:18:48.961768 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 537/1080] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:49.972727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7fb49ce3-4496-445d-abc8-06f9a0ce00f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:49.973686 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7fb49ce3-4496-445d-abc8-06f9a0ce00f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:49.980700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7fb49ce3-4496-445d-abc8-06f9a0ce00f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:49.981144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7fb49ce3-4496-445d-abc8-06f9a0ce00f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:49.981902 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7fb49ce3-4496-445d-abc8-06f9a0ce00f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:49.982363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7fb49ce3-4496-445d-abc8-06f9a0ce00f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:50.012688 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7fb49ce3-4496-445d-abc8-06f9a0ce00f9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043854 May 24 13:18:50.013233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 544/1081] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:51.024353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-139d703f-6973-4f1a-b81d-08e363d20b7c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:51.025298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-139d703f-6973-4f1a-b81d-08e363d20b7c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:51.032303 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-139d703f-6973-4f1a-b81d-08e363d20b7c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:51.032750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-139d703f-6973-4f1a-b81d-08e363d20b7c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:51.033504 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-139d703f-6973-4f1a-b81d-08e363d20b7c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:51.033936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-139d703f-6973-4f1a-b81d-08e363d20b7c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:51.062145 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-139d703f-6973-4f1a-b81d-08e363d20b7c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041774 May 24 13:18:51.062717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 538/1082] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:52.073691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d0a0e670-4908-4068-9440-01b4a2394a9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:52.074627 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d0a0e670-4908-4068-9440-01b4a2394a9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:52.076947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:18:52.082242 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0a0e670-4908-4068-9440-01b4a2394a9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:52.082732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0a0e670-4908-4068-9440-01b4a2394a9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:52.083504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0a0e670-4908-4068-9440-01b4a2394a9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:52.083948 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0a0e670-4908-4068-9440-01b4a2394a9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:52.087762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:18:52.113799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d0a0e670-4908-4068-9440-01b4a2394a9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044641 May 24 13:18:52.114650 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 545/1083] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:53.125551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e2a5b41-e1be-477a-a4b4-b89dd7a30455 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:53.126494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e2a5b41-e1be-477a-a4b4-b89dd7a30455 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:53.128881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:18:53.134598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2a5b41-e1be-477a-a4b4-b89dd7a30455 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:53.135062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2a5b41-e1be-477a-a4b4-b89dd7a30455 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:53.135849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2a5b41-e1be-477a-a4b4-b89dd7a30455 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:53.136290 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2a5b41-e1be-477a-a4b4-b89dd7a30455 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:53.140033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:18:53.165916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e2a5b41-e1be-477a-a4b4-b89dd7a30455 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044325 May 24 13:18:53.167098 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 539/1084] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:18:54.177979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4a537fdb-9072-4483-acac-e876ba395beb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:54.178922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4a537fdb-9072-4483-acac-e876ba395beb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:54.186006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4a537fdb-9072-4483-acac-e876ba395beb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:54.186495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4a537fdb-9072-4483-acac-e876ba395beb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:54.187251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4a537fdb-9072-4483-acac-e876ba395beb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:54.187687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4a537fdb-9072-4483-acac-e876ba395beb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:54.215860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4a537fdb-9072-4483-acac-e876ba395beb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041871 May 24 13:18:54.216388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 546/1085] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:55.227334 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c8085bb5-7998-4de0-864f-35c23b962ee4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:55.228251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c8085bb5-7998-4de0-864f-35c23b962ee4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:55.234723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8085bb5-7998-4de0-864f-35c23b962ee4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:55.235171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8085bb5-7998-4de0-864f-35c23b962ee4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:55.235921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8085bb5-7998-4de0-864f-35c23b962ee4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:55.236351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8085bb5-7998-4de0-864f-35c23b962ee4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:55.266018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c8085bb5-7998-4de0-864f-35c23b962ee4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042645 May 24 13:18:55.266589 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 540/1086] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:56.278376 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c9885db0-d9ab-4bbf-8fad-138abb1240f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:56.279228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c9885db0-d9ab-4bbf-8fad-138abb1240f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:56.285764 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9885db0-d9ab-4bbf-8fad-138abb1240f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:56.286215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9885db0-d9ab-4bbf-8fad-138abb1240f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:56.287027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9885db0-d9ab-4bbf-8fad-138abb1240f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:56.287464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9885db0-d9ab-4bbf-8fad-138abb1240f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:56.316110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c9885db0-d9ab-4bbf-8fad-138abb1240f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042457 May 24 13:18:56.316657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 547/1087] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:57.327861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d7c6726c-b7aa-4829-aeea-486924d15e9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:57.328778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d7c6726c-b7aa-4829-aeea-486924d15e9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:57.335248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7c6726c-b7aa-4829-aeea-486924d15e9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:57.335691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7c6726c-b7aa-4829-aeea-486924d15e9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:57.336446 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7c6726c-b7aa-4829-aeea-486924d15e9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:57.336872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7c6726c-b7aa-4829-aeea-486924d15e9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:57.366799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d7c6726c-b7aa-4829-aeea-486924d15e9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043001 May 24 13:18:57.367346 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 541/1088] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:58.378619 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fcc485b4-ff12-4950-8f03-af89e7083ca0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:58.379472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fcc485b4-ff12-4950-8f03-af89e7083ca0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:58.386030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcc485b4-ff12-4950-8f03-af89e7083ca0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:58.386511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcc485b4-ff12-4950-8f03-af89e7083ca0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:58.387271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcc485b4-ff12-4950-8f03-af89e7083ca0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:58.387706 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fcc485b4-ff12-4950-8f03-af89e7083ca0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:58.419839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fcc485b4-ff12-4950-8f03-af89e7083ca0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044138 May 24 13:18:58.421886 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 548/1089] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:58 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:18:59.434066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc73b975-8c2e-4cd8-8546-1d4f80d232fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:18:59.435043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cc73b975-8c2e-4cd8-8546-1d4f80d232fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:18:59.441556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc73b975-8c2e-4cd8-8546-1d4f80d232fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:59.442006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc73b975-8c2e-4cd8-8546-1d4f80d232fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:59.442804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc73b975-8c2e-4cd8-8546-1d4f80d232fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:18:59.443241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc73b975-8c2e-4cd8-8546-1d4f80d232fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:18:59.472250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cc73b975-8c2e-4cd8-8546-1d4f80d232fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042784 May 24 13:18:59.472792 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 542/1090] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:18:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:00.484195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-125f1c93-d986-4902-bf93-0c6b284ea559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:00.485138 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-125f1c93-d986-4902-bf93-0c6b284ea559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:00.491898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-125f1c93-d986-4902-bf93-0c6b284ea559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:00.492378 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-125f1c93-d986-4902-bf93-0c6b284ea559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:00.493150 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-125f1c93-d986-4902-bf93-0c6b284ea559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:00.493591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-125f1c93-d986-4902-bf93-0c6b284ea559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:00.523396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-125f1c93-d986-4902-bf93-0c6b284ea559 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043398 May 24 13:19:00.523939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 549/1091] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:01.535095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b7ae8442-cb24-4d61-b35c-2a3fbd8e8b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:01.536024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b7ae8442-cb24-4d61-b35c-2a3fbd8e8b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:01.542574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7ae8442-cb24-4d61-b35c-2a3fbd8e8b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:01.543030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7ae8442-cb24-4d61-b35c-2a3fbd8e8b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:01.543800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7ae8442-cb24-4d61-b35c-2a3fbd8e8b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:01.544236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7ae8442-cb24-4d61-b35c-2a3fbd8e8b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:01.573335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b7ae8442-cb24-4d61-b35c-2a3fbd8e8b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042307 May 24 13:19:01.573880 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 543/1092] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:02.584990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e014cec6-11e7-48b3-8f56-69b9a90c8eb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:02.585909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e014cec6-11e7-48b3-8f56-69b9a90c8eb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:02.592854 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e014cec6-11e7-48b3-8f56-69b9a90c8eb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:02.593301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e014cec6-11e7-48b3-8f56-69b9a90c8eb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:02.594054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e014cec6-11e7-48b3-8f56-69b9a90c8eb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:02.594519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e014cec6-11e7-48b3-8f56-69b9a90c8eb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:02.623820 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e014cec6-11e7-48b3-8f56-69b9a90c8eb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042760 May 24 13:19:02.624355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 550/1093] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:03.636222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f1a181f8-cf34-4d83-a657-fe35ecd26ae4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:03.637172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f1a181f8-cf34-4d83-a657-fe35ecd26ae4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:03.643711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1a181f8-cf34-4d83-a657-fe35ecd26ae4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:03.644158 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1a181f8-cf34-4d83-a657-fe35ecd26ae4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:03.644923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1a181f8-cf34-4d83-a657-fe35ecd26ae4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:03.645357 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1a181f8-cf34-4d83-a657-fe35ecd26ae4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:03.674371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f1a181f8-cf34-4d83-a657-fe35ecd26ae4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042603 May 24 13:19:03.674839 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 544/1094] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:04.685983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6b4b0066-b476-4ed5-9df3-ee1c7aa65d97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:04.686931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6b4b0066-b476-4ed5-9df3-ee1c7aa65d97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:04.693435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6b4b0066-b476-4ed5-9df3-ee1c7aa65d97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:04.693884 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6b4b0066-b476-4ed5-9df3-ee1c7aa65d97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:04.694666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6b4b0066-b476-4ed5-9df3-ee1c7aa65d97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:04.695104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6b4b0066-b476-4ed5-9df3-ee1c7aa65d97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:04.730352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6b4b0066-b476-4ed5-9df3-ee1c7aa65d97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048368 May 24 13:19:04.730909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 551/1095] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:05.742818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6bffd578-03bd-4684-9d00-90fbeb2e9ed3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:05.743639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6bffd578-03bd-4684-9d00-90fbeb2e9ed3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:05.750211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bffd578-03bd-4684-9d00-90fbeb2e9ed3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:05.750695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bffd578-03bd-4684-9d00-90fbeb2e9ed3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:05.751467 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bffd578-03bd-4684-9d00-90fbeb2e9ed3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:05.751908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bffd578-03bd-4684-9d00-90fbeb2e9ed3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:05.780937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6bffd578-03bd-4684-9d00-90fbeb2e9ed3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042579 May 24 13:19:05.781483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 545/1096] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:06.792680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-160244ff-8cd4-4d9f-947f-6a6941fced0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:06.793525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-160244ff-8cd4-4d9f-947f-6a6941fced0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:06.800038 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-160244ff-8cd4-4d9f-947f-6a6941fced0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:06.800486 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-160244ff-8cd4-4d9f-947f-6a6941fced0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:06.801245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-160244ff-8cd4-4d9f-947f-6a6941fced0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:06.801680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-160244ff-8cd4-4d9f-947f-6a6941fced0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:06.830427 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-160244ff-8cd4-4d9f-947f-6a6941fced0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041803 May 24 13:19:06.830960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 552/1097] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:07.792130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:19:07.792691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:19:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:19:07.841933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a1d78a4b-12d9-4a84-8c9e-c743b22d78bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:07.842889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a1d78a4b-12d9-4a84-8c9e-c743b22d78bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:07.849425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1d78a4b-12d9-4a84-8c9e-c743b22d78bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:07.849876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1d78a4b-12d9-4a84-8c9e-c743b22d78bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:07.850668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1d78a4b-12d9-4a84-8c9e-c743b22d78bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:07.851107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1d78a4b-12d9-4a84-8c9e-c743b22d78bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:07.880905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a1d78a4b-12d9-4a84-8c9e-c743b22d78bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043257 May 24 13:19:07.881442 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 546/1098] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:08.892578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a82fe627-27e2-40b0-a44d-deb9e5660159 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:08.893496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a82fe627-27e2-40b0-a44d-deb9e5660159 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:08.899911 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a82fe627-27e2-40b0-a44d-deb9e5660159 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:08.900858 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a82fe627-27e2-40b0-a44d-deb9e5660159 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:08.901610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a82fe627-27e2-40b0-a44d-deb9e5660159 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:08.902042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a82fe627-27e2-40b0-a44d-deb9e5660159 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:08.931129 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a82fe627-27e2-40b0-a44d-deb9e5660159 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042516 May 24 13:19:08.931870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 553/1099] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:09.942952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-91061676-098d-4761-a2eb-5c6294d730d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:09.943875 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-91061676-098d-4761-a2eb-5c6294d730d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:09.950349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91061676-098d-4761-a2eb-5c6294d730d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:09.950806 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91061676-098d-4761-a2eb-5c6294d730d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:09.951568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91061676-098d-4761-a2eb-5c6294d730d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:09.952004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91061676-098d-4761-a2eb-5c6294d730d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:09.980555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-91061676-098d-4761-a2eb-5c6294d730d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041619 May 24 13:19:09.981089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 547/1100] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:10.992362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b5948725-8770-40af-b976-cba4bdf3a379 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:10.993326 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b5948725-8770-40af-b976-cba4bdf3a379 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:11.000303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5948725-8770-40af-b976-cba4bdf3a379 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:11.000762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5948725-8770-40af-b976-cba4bdf3a379 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:11.001525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5948725-8770-40af-b976-cba4bdf3a379 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:11.001971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5948725-8770-40af-b976-cba4bdf3a379 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:11.030944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b5948725-8770-40af-b976-cba4bdf3a379 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042888 May 24 13:19:11.031485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 554/1101] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:12.042607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ac4585f3-8f30-4d60-90bc-58ad62a32d1f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:12.043587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ac4585f3-8f30-4d60-90bc-58ad62a32d1f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:12.050091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac4585f3-8f30-4d60-90bc-58ad62a32d1f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:12.050571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac4585f3-8f30-4d60-90bc-58ad62a32d1f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:12.051336 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac4585f3-8f30-4d60-90bc-58ad62a32d1f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:12.051771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac4585f3-8f30-4d60-90bc-58ad62a32d1f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:12.081017 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ac4585f3-8f30-4d60-90bc-58ad62a32d1f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042428 May 24 13:19:12.081557 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 548/1102] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:13.093205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b5558692-b40b-47f8-b50c-00fdfd905513 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:13.094063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b5558692-b40b-47f8-b50c-00fdfd905513 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:13.100620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5558692-b40b-47f8-b50c-00fdfd905513 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:13.101075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5558692-b40b-47f8-b50c-00fdfd905513 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:13.101847 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5558692-b40b-47f8-b50c-00fdfd905513 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:13.102316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5558692-b40b-47f8-b50c-00fdfd905513 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:13.131777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b5558692-b40b-47f8-b50c-00fdfd905513 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042681 May 24 13:19:13.132327 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 555/1103] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:14.143341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4056c748-72aa-4f08-8a29-b9bc98da89e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:14.144311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4056c748-72aa-4f08-8a29-b9bc98da89e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:14.150916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4056c748-72aa-4f08-8a29-b9bc98da89e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:14.151370 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4056c748-72aa-4f08-8a29-b9bc98da89e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:14.152174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4056c748-72aa-4f08-8a29-b9bc98da89e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:14.152612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4056c748-72aa-4f08-8a29-b9bc98da89e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:14.181273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4056c748-72aa-4f08-8a29-b9bc98da89e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041880 May 24 13:19:14.182366 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 549/1104] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:15.193433 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-53789c7c-b466-4a24-936c-561f09e710a7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:15.194390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-53789c7c-b466-4a24-936c-561f09e710a7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:15.201444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-53789c7c-b466-4a24-936c-561f09e710a7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:15.201897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-53789c7c-b466-4a24-936c-561f09e710a7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:15.202694 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-53789c7c-b466-4a24-936c-561f09e710a7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:15.203134 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-53789c7c-b466-4a24-936c-561f09e710a7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:15.232146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-53789c7c-b466-4a24-936c-561f09e710a7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042757 May 24 13:19:15.232688 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 556/1105] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:16.245636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-117b66d4-dd3f-40b6-9928-e8982a60ef50 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:16.246624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-117b66d4-dd3f-40b6-9928-e8982a60ef50 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:16.253107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117b66d4-dd3f-40b6-9928-e8982a60ef50 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:16.253555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117b66d4-dd3f-40b6-9928-e8982a60ef50 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:16.254338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117b66d4-dd3f-40b6-9928-e8982a60ef50 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:16.254776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-117b66d4-dd3f-40b6-9928-e8982a60ef50 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:16.283790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-117b66d4-dd3f-40b6-9928-e8982a60ef50 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042685 May 24 13:19:16.284329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 550/1106] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:17.295357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-551ec87b-ade1-46f5-89b6-407a94e70eb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:17.296283 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-551ec87b-ade1-46f5-89b6-407a94e70eb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:17.302377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-551ec87b-ade1-46f5-89b6-407a94e70eb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:17.302826 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-551ec87b-ade1-46f5-89b6-407a94e70eb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:17.303576 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-551ec87b-ade1-46f5-89b6-407a94e70eb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:17.304009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-551ec87b-ade1-46f5-89b6-407a94e70eb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:17.332751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-551ec87b-ade1-46f5-89b6-407a94e70eb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041515 May 24 13:19:17.333289 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 557/1107] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:18.344632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-18a960e2-e1af-4552-84f1-6a27965d961e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:18.345546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-18a960e2-e1af-4552-84f1-6a27965d961e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:18.351967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18a960e2-e1af-4552-84f1-6a27965d961e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:18.352413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18a960e2-e1af-4552-84f1-6a27965d961e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:18.353249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18a960e2-e1af-4552-84f1-6a27965d961e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:18.354185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18a960e2-e1af-4552-84f1-6a27965d961e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:18.383214 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-18a960e2-e1af-4552-84f1-6a27965d961e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042428 May 24 13:19:18.383698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 551/1108] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:19.394745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-34300d76-958d-4262-90c2-6fc7f2e761a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:19.395675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-34300d76-958d-4262-90c2-6fc7f2e761a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:19.402249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34300d76-958d-4262-90c2-6fc7f2e761a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:19.402728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34300d76-958d-4262-90c2-6fc7f2e761a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:19.403493 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34300d76-958d-4262-90c2-6fc7f2e761a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:19.403929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34300d76-958d-4262-90c2-6fc7f2e761a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:19.433184 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-34300d76-958d-4262-90c2-6fc7f2e761a3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042454 May 24 13:19:19.433731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 558/1109] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:20.444848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-41e62a00-2f99-423b-bf1a-d2da4055ef6d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:20.445776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41e62a00-2f99-423b-bf1a-d2da4055ef6d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:20.452263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41e62a00-2f99-423b-bf1a-d2da4055ef6d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:20.452714 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41e62a00-2f99-423b-bf1a-d2da4055ef6d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:20.453472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41e62a00-2f99-423b-bf1a-d2da4055ef6d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:20.453909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41e62a00-2f99-423b-bf1a-d2da4055ef6d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:20.482946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-41e62a00-2f99-423b-bf1a-d2da4055ef6d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042043 May 24 13:19:20.483486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 552/1110] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:21.495346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-654ee8c5-d523-49be-98aa-8d506ba8a5ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:21.496273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-654ee8c5-d523-49be-98aa-8d506ba8a5ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:21.502707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-654ee8c5-d523-49be-98aa-8d506ba8a5ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:21.503157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-654ee8c5-d523-49be-98aa-8d506ba8a5ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:21.503911 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-654ee8c5-d523-49be-98aa-8d506ba8a5ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:21.504350 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-654ee8c5-d523-49be-98aa-8d506ba8a5ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:21.532951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-654ee8c5-d523-49be-98aa-8d506ba8a5ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042097 May 24 13:19:21.533484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 559/1111] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:22.544717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc6f085f-136f-4db1-91a5-7b982b55240e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:22.545667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cc6f085f-136f-4db1-91a5-7b982b55240e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:22.552370 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc6f085f-136f-4db1-91a5-7b982b55240e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:22.552824 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc6f085f-136f-4db1-91a5-7b982b55240e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:22.553593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc6f085f-136f-4db1-91a5-7b982b55240e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:22.554030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc6f085f-136f-4db1-91a5-7b982b55240e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:22.584680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cc6f085f-136f-4db1-91a5-7b982b55240e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044066 May 24 13:19:22.585229 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 553/1112] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:23.596458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fd77cad8-9d5c-485d-80f1-36fa29bffc35 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:23.597416 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fd77cad8-9d5c-485d-80f1-36fa29bffc35 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:23.600725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:19:23.606746 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fd77cad8-9d5c-485d-80f1-36fa29bffc35 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:23.607178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fd77cad8-9d5c-485d-80f1-36fa29bffc35 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:23.607953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fd77cad8-9d5c-485d-80f1-36fa29bffc35 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:23.608898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fd77cad8-9d5c-485d-80f1-36fa29bffc35 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:23.611560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:19:23.640592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fd77cad8-9d5c-485d-80f1-36fa29bffc35 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048289 May 24 13:19:23.641154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 560/1113] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:24.652240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d5d72f17-a897-413f-b384-14e3d69695aa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:24.653157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d5d72f17-a897-413f-b384-14e3d69695aa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:24.655559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:19:24.661009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d5d72f17-a897-413f-b384-14e3d69695aa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:24.661395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d5d72f17-a897-413f-b384-14e3d69695aa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:24.662149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d5d72f17-a897-413f-b384-14e3d69695aa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:24.662612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d5d72f17-a897-413f-b384-14e3d69695aa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:24.666265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:19:24.693206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d5d72f17-a897-413f-b384-14e3d69695aa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044973 May 24 13:19:24.693756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 554/1114] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:25.705065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9f56bf0d-7b4d-499d-ad95-4d659f92c07b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:25.705918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9f56bf0d-7b4d-499d-ad95-4d659f92c07b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:25.712600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9f56bf0d-7b4d-499d-ad95-4d659f92c07b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:25.713054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9f56bf0d-7b4d-499d-ad95-4d659f92c07b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:25.714482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9f56bf0d-7b4d-499d-ad95-4d659f92c07b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:25.714924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9f56bf0d-7b4d-499d-ad95-4d659f92c07b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:25.743671 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9f56bf0d-7b4d-499d-ad95-4d659f92c07b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042625 May 24 13:19:25.744213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 561/1115] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:26.755315 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d65c7e9a-e18f-4000-8209-a751467bfdd6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:26.756162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d65c7e9a-e18f-4000-8209-a751467bfdd6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:26.762996 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d65c7e9a-e18f-4000-8209-a751467bfdd6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:26.763443 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d65c7e9a-e18f-4000-8209-a751467bfdd6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:26.764206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d65c7e9a-e18f-4000-8209-a751467bfdd6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:26.764670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d65c7e9a-e18f-4000-8209-a751467bfdd6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:26.795066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d65c7e9a-e18f-4000-8209-a751467bfdd6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043757 May 24 13:19:26.795615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 555/1116] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:27.806507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2b0c55a3-8a41-4ebb-bbef-28ffdb60a405 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:27.807404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2b0c55a3-8a41-4ebb-bbef-28ffdb60a405 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:27.813889 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b0c55a3-8a41-4ebb-bbef-28ffdb60a405 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:27.814462 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b0c55a3-8a41-4ebb-bbef-28ffdb60a405 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:27.815221 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b0c55a3-8a41-4ebb-bbef-28ffdb60a405 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:27.815673 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b0c55a3-8a41-4ebb-bbef-28ffdb60a405 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:27.846483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2b0c55a3-8a41-4ebb-bbef-28ffdb60a405 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043984 May 24 13:19:27.847030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 562/1117] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:28.858050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60a466c1-dbbe-4539-b12b-c2a3362ca98d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:28.859002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60a466c1-dbbe-4539-b12b-c2a3362ca98d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:28.865736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60a466c1-dbbe-4539-b12b-c2a3362ca98d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:28.866184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60a466c1-dbbe-4539-b12b-c2a3362ca98d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:28.866969 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60a466c1-dbbe-4539-b12b-c2a3362ca98d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:28.867405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60a466c1-dbbe-4539-b12b-c2a3362ca98d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:28.895918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60a466c1-dbbe-4539-b12b-c2a3362ca98d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042449 May 24 13:19:28.896454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 556/1118] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:29.907933 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b6842eeb-6999-46ab-aef0-c373fde85daf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:29.908862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b6842eeb-6999-46ab-aef0-c373fde85daf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:29.915296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b6842eeb-6999-46ab-aef0-c373fde85daf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:29.915748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b6842eeb-6999-46ab-aef0-c373fde85daf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:29.917144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b6842eeb-6999-46ab-aef0-c373fde85daf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:29.917584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b6842eeb-6999-46ab-aef0-c373fde85daf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:29.945823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b6842eeb-6999-46ab-aef0-c373fde85daf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041879 May 24 13:19:29.946392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 563/1119] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:30.957808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cafcee3e-0789-42bf-9b71-6ae2596addc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:30.958789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cafcee3e-0789-42bf-9b71-6ae2596addc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:30.965239 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cafcee3e-0789-42bf-9b71-6ae2596addc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:30.965693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cafcee3e-0789-42bf-9b71-6ae2596addc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:30.966489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cafcee3e-0789-42bf-9b71-6ae2596addc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:30.966930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cafcee3e-0789-42bf-9b71-6ae2596addc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:30.996639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cafcee3e-0789-42bf-9b71-6ae2596addc1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042823 May 24 13:19:30.997175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 557/1120] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:32.008090 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-70ec2dd7-db41-49e7-a202-8d5eb4fc0acd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:32.009054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-70ec2dd7-db41-49e7-a202-8d5eb4fc0acd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:32.015589 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-70ec2dd7-db41-49e7-a202-8d5eb4fc0acd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:32.016047 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-70ec2dd7-db41-49e7-a202-8d5eb4fc0acd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:32.016812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-70ec2dd7-db41-49e7-a202-8d5eb4fc0acd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:32.017253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-70ec2dd7-db41-49e7-a202-8d5eb4fc0acd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:32.046913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-70ec2dd7-db41-49e7-a202-8d5eb4fc0acd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042756 May 24 13:19:32.047462 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 564/1121] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:33.059108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c94a560f-b56b-4548-ba1a-5b721f1d368d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:33.060057 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c94a560f-b56b-4548-ba1a-5b721f1d368d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:33.066526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c94a560f-b56b-4548-ba1a-5b721f1d368d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:33.066979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c94a560f-b56b-4548-ba1a-5b721f1d368d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:33.067739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c94a560f-b56b-4548-ba1a-5b721f1d368d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:33.068176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c94a560f-b56b-4548-ba1a-5b721f1d368d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:33.096597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c94a560f-b56b-4548-ba1a-5b721f1d368d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042121 May 24 13:19:33.097142 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 558/1122] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:34.107628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-98202a7d-6066-4bac-b525-28bf4735450b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:34.108598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-98202a7d-6066-4bac-b525-28bf4735450b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:34.115394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-98202a7d-6066-4bac-b525-28bf4735450b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:34.115850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-98202a7d-6066-4bac-b525-28bf4735450b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:34.116619 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-98202a7d-6066-4bac-b525-28bf4735450b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:34.117061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-98202a7d-6066-4bac-b525-28bf4735450b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:34.146938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-98202a7d-6066-4bac-b525-28bf4735450b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043257 May 24 13:19:34.147488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 565/1123] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:35.158660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-71920df3-c085-49e5-a9ed-f277ddedd91d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:35.159578 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-71920df3-c085-49e5-a9ed-f277ddedd91d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:35.166757 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71920df3-c085-49e5-a9ed-f277ddedd91d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:35.167221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71920df3-c085-49e5-a9ed-f277ddedd91d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:35.167960 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71920df3-c085-49e5-a9ed-f277ddedd91d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:35.168395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71920df3-c085-49e5-a9ed-f277ddedd91d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:35.197884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-71920df3-c085-49e5-a9ed-f277ddedd91d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043191 May 24 13:19:35.198454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 559/1124] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:36.209509 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d5ce39a9-5499-4afb-ae0b-4b03a4bc3bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:36.210467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d5ce39a9-5499-4afb-ae0b-4b03a4bc3bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:36.217632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5ce39a9-5499-4afb-ae0b-4b03a4bc3bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:36.218084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5ce39a9-5499-4afb-ae0b-4b03a4bc3bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:36.218888 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5ce39a9-5499-4afb-ae0b-4b03a4bc3bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:36.219329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d5ce39a9-5499-4afb-ae0b-4b03a4bc3bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:36.248067 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d5ce39a9-5499-4afb-ae0b-4b03a4bc3bcf tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042508 May 24 13:19:36.248616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 566/1125] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:37.259892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b57bb251-1cec-4281-9fd5-f50d0241a933 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:37.260825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b57bb251-1cec-4281-9fd5-f50d0241a933 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:37.267216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57bb251-1cec-4281-9fd5-f50d0241a933 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:37.267663 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57bb251-1cec-4281-9fd5-f50d0241a933 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:37.268419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57bb251-1cec-4281-9fd5-f50d0241a933 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:37.268851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57bb251-1cec-4281-9fd5-f50d0241a933 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:37.298396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b57bb251-1cec-4281-9fd5-f50d0241a933 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042434 May 24 13:19:37.298933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 560/1126] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:38.310513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f258a825-4215-491f-84f5-f630922e77e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:38.311482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f258a825-4215-491f-84f5-f630922e77e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:38.317990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f258a825-4215-491f-84f5-f630922e77e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:38.318546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f258a825-4215-491f-84f5-f630922e77e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:38.319314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f258a825-4215-491f-84f5-f630922e77e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:38.319759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f258a825-4215-491f-84f5-f630922e77e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:38.348098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f258a825-4215-491f-84f5-f630922e77e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042188 May 24 13:19:38.348636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 567/1127] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:39.359622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e0c80f8e-f178-40f5-87eb-244ec7e6795c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:39.360537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e0c80f8e-f178-40f5-87eb-244ec7e6795c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:39.367200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0c80f8e-f178-40f5-87eb-244ec7e6795c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:39.367642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0c80f8e-f178-40f5-87eb-244ec7e6795c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:39.368400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0c80f8e-f178-40f5-87eb-244ec7e6795c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:39.368832 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0c80f8e-f178-40f5-87eb-244ec7e6795c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:39.399193 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e0c80f8e-f178-40f5-87eb-244ec7e6795c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043527 May 24 13:19:39.399747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 561/1128] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:40.410850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4063aaab-2714-4ad9-92be-3ca9737d2d89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:40.411773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4063aaab-2714-4ad9-92be-3ca9737d2d89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:40.418853 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4063aaab-2714-4ad9-92be-3ca9737d2d89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:40.419302 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4063aaab-2714-4ad9-92be-3ca9737d2d89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:40.420057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4063aaab-2714-4ad9-92be-3ca9737d2d89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:40.420490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4063aaab-2714-4ad9-92be-3ca9737d2d89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:40.450364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4063aaab-2714-4ad9-92be-3ca9737d2d89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043463 May 24 13:19:40.450905 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 568/1129] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:41.461200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5c3ff5c7-bf1e-42ae-b07c-6409d326ba69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:41.462119 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5c3ff5c7-bf1e-42ae-b07c-6409d326ba69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:41.469249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c3ff5c7-bf1e-42ae-b07c-6409d326ba69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:41.469697 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c3ff5c7-bf1e-42ae-b07c-6409d326ba69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:41.470494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c3ff5c7-bf1e-42ae-b07c-6409d326ba69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:41.470936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c3ff5c7-bf1e-42ae-b07c-6409d326ba69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:41.499904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5c3ff5c7-bf1e-42ae-b07c-6409d326ba69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042732 May 24 13:19:41.500479 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 562/1130] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:42.511474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-17acb8b2-7313-4bb0-b088-94bacea9d9fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:42.512400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-17acb8b2-7313-4bb0-b088-94bacea9d9fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:42.518828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-17acb8b2-7313-4bb0-b088-94bacea9d9fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:42.519274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-17acb8b2-7313-4bb0-b088-94bacea9d9fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:42.520335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-17acb8b2-7313-4bb0-b088-94bacea9d9fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:42.520775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-17acb8b2-7313-4bb0-b088-94bacea9d9fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:42.550323 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-17acb8b2-7313-4bb0-b088-94bacea9d9fd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042817 May 24 13:19:42.550865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 569/1131] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:43.561520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c12f9a1e-5a9e-4124-a2d5-ba0a9b43e0e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:43.562476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c12f9a1e-5a9e-4124-a2d5-ba0a9b43e0e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:43.568913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c12f9a1e-5a9e-4124-a2d5-ba0a9b43e0e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:43.569359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c12f9a1e-5a9e-4124-a2d5-ba0a9b43e0e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:43.570107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c12f9a1e-5a9e-4124-a2d5-ba0a9b43e0e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:43.570574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c12f9a1e-5a9e-4124-a2d5-ba0a9b43e0e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:43.599448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c12f9a1e-5a9e-4124-a2d5-ba0a9b43e0e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042418 May 24 13:19:43.600010 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 563/1132] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:44.611013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5e1a9f33-4c76-4621-b078-194443012043 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:44.611938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5e1a9f33-4c76-4621-b078-194443012043 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:44.618626 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f33-4c76-4621-b078-194443012043 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:44.619076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f33-4c76-4621-b078-194443012043 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:44.619830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f33-4c76-4621-b078-194443012043 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:44.620799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f33-4c76-4621-b078-194443012043 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:44.649380 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5e1a9f33-4c76-4621-b078-194443012043 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042356 May 24 13:19:44.649910 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 570/1133] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:45.662455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-785922e9-e8bb-4769-b1cb-d9d87b95eee2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:45.663294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-785922e9-e8bb-4769-b1cb-d9d87b95eee2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:45.670371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-785922e9-e8bb-4769-b1cb-d9d87b95eee2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:45.670824 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-785922e9-e8bb-4769-b1cb-d9d87b95eee2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:45.671584 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-785922e9-e8bb-4769-b1cb-d9d87b95eee2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:45.672020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-785922e9-e8bb-4769-b1cb-d9d87b95eee2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:45.700933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-785922e9-e8bb-4769-b1cb-d9d87b95eee2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042567 May 24 13:19:45.701476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 564/1134] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:46.712590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-245e856a-22c7-4e6f-939f-55e019c87bf2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:46.713430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-245e856a-22c7-4e6f-939f-55e019c87bf2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:46.719834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-245e856a-22c7-4e6f-939f-55e019c87bf2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:46.720294 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-245e856a-22c7-4e6f-939f-55e019c87bf2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:46.721059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-245e856a-22c7-4e6f-939f-55e019c87bf2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:46.721524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-245e856a-22c7-4e6f-939f-55e019c87bf2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:46.751259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-245e856a-22c7-4e6f-939f-55e019c87bf2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042754 May 24 13:19:46.751793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 571/1135] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:47.763147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-04bb08c9-c6f0-49e6-8f20-01c75171e0ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:47.763992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-04bb08c9-c6f0-49e6-8f20-01c75171e0ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:47.770072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04bb08c9-c6f0-49e6-8f20-01c75171e0ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:47.770562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04bb08c9-c6f0-49e6-8f20-01c75171e0ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:47.771352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04bb08c9-c6f0-49e6-8f20-01c75171e0ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:47.771788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04bb08c9-c6f0-49e6-8f20-01c75171e0ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:47.801889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-04bb08c9-c6f0-49e6-8f20-01c75171e0ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043026 May 24 13:19:47.802468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 565/1136] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:48.813922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7741daf0-8e35-4716-b987-071a6a5bd4a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:48.814916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7741daf0-8e35-4716-b987-071a6a5bd4a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:48.821472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7741daf0-8e35-4716-b987-071a6a5bd4a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:48.821929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7741daf0-8e35-4716-b987-071a6a5bd4a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:48.822739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7741daf0-8e35-4716-b987-071a6a5bd4a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:48.823182 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7741daf0-8e35-4716-b987-071a6a5bd4a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:48.852426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7741daf0-8e35-4716-b987-071a6a5bd4a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042479 May 24 13:19:48.852976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 572/1137] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:49.864824 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-08515e38-d767-441d-86e7-ccb610867691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:49.865750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-08515e38-d767-441d-86e7-ccb610867691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:49.872266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08515e38-d767-441d-86e7-ccb610867691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:49.872697 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08515e38-d767-441d-86e7-ccb610867691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:49.873457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08515e38-d767-441d-86e7-ccb610867691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:49.873890 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08515e38-d767-441d-86e7-ccb610867691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:49.902799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-08515e38-d767-441d-86e7-ccb610867691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042243 May 24 13:19:49.903335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 566/1138] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:50.913845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8f228749-bf9b-4ffc-a70f-cba5f7d381bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:50.914814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8f228749-bf9b-4ffc-a70f-cba5f7d381bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:50.921297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f228749-bf9b-4ffc-a70f-cba5f7d381bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:50.921748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f228749-bf9b-4ffc-a70f-cba5f7d381bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:50.922539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f228749-bf9b-4ffc-a70f-cba5f7d381bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:50.922976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f228749-bf9b-4ffc-a70f-cba5f7d381bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:50.951704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8f228749-bf9b-4ffc-a70f-cba5f7d381bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041858 May 24 13:19:50.952239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 573/1139] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:51.963241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6e9cf8e5-61af-4866-987c-e40254cf94a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:51.964153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6e9cf8e5-61af-4866-987c-e40254cf94a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:51.971088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e9cf8e5-61af-4866-987c-e40254cf94a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:51.971532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e9cf8e5-61af-4866-987c-e40254cf94a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:51.972288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e9cf8e5-61af-4866-987c-e40254cf94a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:51.972718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e9cf8e5-61af-4866-987c-e40254cf94a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:52.002029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6e9cf8e5-61af-4866-987c-e40254cf94a0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042780 May 24 13:19:52.002595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 567/1140] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:53.013125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-654ea8f6-a97a-49ea-b3e4-b71b65ed2798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:53.014056 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-654ea8f6-a97a-49ea-b3e4-b71b65ed2798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:53.020650 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-654ea8f6-a97a-49ea-b3e4-b71b65ed2798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:53.021105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-654ea8f6-a97a-49ea-b3e4-b71b65ed2798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:53.021873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-654ea8f6-a97a-49ea-b3e4-b71b65ed2798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:53.022333 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-654ea8f6-a97a-49ea-b3e4-b71b65ed2798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:53.051971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-654ea8f6-a97a-49ea-b3e4-b71b65ed2798 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042860 May 24 13:19:53.052525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 574/1141] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:54.064143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e70c542-3b52-4ef2-9f46-cec53ec427da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:54.065101 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e70c542-3b52-4ef2-9f46-cec53ec427da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:54.071568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e70c542-3b52-4ef2-9f46-cec53ec427da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:54.072018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e70c542-3b52-4ef2-9f46-cec53ec427da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:54.072786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e70c542-3b52-4ef2-9f46-cec53ec427da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:54.073224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e70c542-3b52-4ef2-9f46-cec53ec427da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:54.106228 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e70c542-3b52-4ef2-9f46-cec53ec427da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045955 May 24 13:19:54.106817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 568/1142] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:55.118204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cfb2a2e1-9bf5-4a6f-be63-c6b92be45369 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:55.119159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cfb2a2e1-9bf5-4a6f-be63-c6b92be45369 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:55.121931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:19:55.127406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cfb2a2e1-9bf5-4a6f-be63-c6b92be45369 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:55.127895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cfb2a2e1-9bf5-4a6f-be63-c6b92be45369 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:55.128661 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cfb2a2e1-9bf5-4a6f-be63-c6b92be45369 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:55.129101 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cfb2a2e1-9bf5-4a6f-be63-c6b92be45369 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:55.131694 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:19:55.159352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cfb2a2e1-9bf5-4a6f-be63-c6b92be45369 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045173 May 24 13:19:55.159909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 575/1143] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:56.171403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-25962176-491f-4bba-99d1-fc916c899452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:56.172358 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-25962176-491f-4bba-99d1-fc916c899452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:56.174869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:19:56.180444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25962176-491f-4bba-99d1-fc916c899452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:56.180893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25962176-491f-4bba-99d1-fc916c899452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:56.181652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25962176-491f-4bba-99d1-fc916c899452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:56.182094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25962176-491f-4bba-99d1-fc916c899452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:56.186194 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:19:56.211765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-25962176-491f-4bba-99d1-fc916c899452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044788 May 24 13:19:56.212313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 569/1144] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:57.223373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-abfb7d68-f89b-4247-bc8b-8c45d54697fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:57.224299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-abfb7d68-f89b-4247-bc8b-8c45d54697fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:57.230785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-abfb7d68-f89b-4247-bc8b-8c45d54697fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:57.231241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-abfb7d68-f89b-4247-bc8b-8c45d54697fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:57.231993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-abfb7d68-f89b-4247-bc8b-8c45d54697fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:57.232429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-abfb7d68-f89b-4247-bc8b-8c45d54697fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:57.261465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-abfb7d68-f89b-4247-bc8b-8c45d54697fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042020 May 24 13:19:57.261940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 576/1145] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:58.274148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1cd0ff82-58d6-4b0e-8e54-49dedf507d70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:58.275095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1cd0ff82-58d6-4b0e-8e54-49dedf507d70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:58.282129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cd0ff82-58d6-4b0e-8e54-49dedf507d70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:58.282614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cd0ff82-58d6-4b0e-8e54-49dedf507d70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:58.283378 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cd0ff82-58d6-4b0e-8e54-49dedf507d70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:58.283817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cd0ff82-58d6-4b0e-8e54-49dedf507d70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:58.313660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1cd0ff82-58d6-4b0e-8e54-49dedf507d70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043425 May 24 13:19:58.314209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 570/1146] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:58 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:19:59.325140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1d3ae4a2-cf30-4c4a-9b39-e818851728b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:19:59.326079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1d3ae4a2-cf30-4c4a-9b39-e818851728b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:19:59.332853 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d3ae4a2-cf30-4c4a-9b39-e818851728b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:59.333303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d3ae4a2-cf30-4c4a-9b39-e818851728b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:59.334067 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d3ae4a2-cf30-4c4a-9b39-e818851728b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:19:59.334533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1d3ae4a2-cf30-4c4a-9b39-e818851728b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:19:59.364702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1d3ae4a2-cf30-4c4a-9b39-e818851728b6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043561 May 24 13:19:59.365249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 577/1147] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:19:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:00.376775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9506b8b9-98c0-4195-a969-41bf81cc32de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:00.377751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9506b8b9-98c0-4195-a969-41bf81cc32de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:00.384226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9506b8b9-98c0-4195-a969-41bf81cc32de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:00.384678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9506b8b9-98c0-4195-a969-41bf81cc32de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:00.386078 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9506b8b9-98c0-4195-a969-41bf81cc32de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:00.386547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9506b8b9-98c0-4195-a969-41bf81cc32de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:00.415742 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9506b8b9-98c0-4195-a969-41bf81cc32de tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042867 May 24 13:20:00.416293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 571/1148] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:00.682983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:20:00.683160 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:20:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:20:01.426604 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-29561cf1-91ce-4a49-80b7-4575c8c10b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:01.427543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-29561cf1-91ce-4a49-80b7-4575c8c10b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:01.434100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-29561cf1-91ce-4a49-80b7-4575c8c10b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:01.434588 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-29561cf1-91ce-4a49-80b7-4575c8c10b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:01.435356 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-29561cf1-91ce-4a49-80b7-4575c8c10b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:01.435794 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-29561cf1-91ce-4a49-80b7-4575c8c10b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:01.466539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-29561cf1-91ce-4a49-80b7-4575c8c10b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043884 May 24 13:20:01.467097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 578/1149] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:02.477800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-712db47d-a39d-4822-924b-77c85036c731 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:02.478775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-712db47d-a39d-4822-924b-77c85036c731 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:02.485748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-712db47d-a39d-4822-924b-77c85036c731 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:02.486193 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-712db47d-a39d-4822-924b-77c85036c731 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:02.486976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-712db47d-a39d-4822-924b-77c85036c731 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:02.487406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-712db47d-a39d-4822-924b-77c85036c731 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:02.517014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-712db47d-a39d-4822-924b-77c85036c731 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043148 May 24 13:20:02.517574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 572/1150] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:03.528636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cc8e0b31-0baa-456c-bc5e-9bb061817013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:03.529566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cc8e0b31-0baa-456c-bc5e-9bb061817013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:03.536009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cc8e0b31-0baa-456c-bc5e-9bb061817013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:03.536462 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cc8e0b31-0baa-456c-bc5e-9bb061817013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:03.537213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cc8e0b31-0baa-456c-bc5e-9bb061817013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:03.537642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cc8e0b31-0baa-456c-bc5e-9bb061817013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:03.566508 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cc8e0b31-0baa-456c-bc5e-9bb061817013 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041681 May 24 13:20:03.567054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 579/1151] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:04.577626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-21dec0bd-54d1-4f19-9b03-f2198a9d5ff8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:04.578624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-21dec0bd-54d1-4f19-9b03-f2198a9d5ff8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:04.585130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21dec0bd-54d1-4f19-9b03-f2198a9d5ff8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:04.585587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21dec0bd-54d1-4f19-9b03-f2198a9d5ff8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:04.586389 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21dec0bd-54d1-4f19-9b03-f2198a9d5ff8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:04.586833 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21dec0bd-54d1-4f19-9b03-f2198a9d5ff8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:04.616043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-21dec0bd-54d1-4f19-9b03-f2198a9d5ff8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042952 May 24 13:20:04.616587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 573/1152] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:05.627628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-db51a9e9-b024-4d76-8200-3c34018015fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:05.628485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-db51a9e9-b024-4d76-8200-3c34018015fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:05.634926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-db51a9e9-b024-4d76-8200-3c34018015fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:05.635374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-db51a9e9-b024-4d76-8200-3c34018015fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:05.636126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-db51a9e9-b024-4d76-8200-3c34018015fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:05.636586 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-db51a9e9-b024-4d76-8200-3c34018015fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:05.665663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-db51a9e9-b024-4d76-8200-3c34018015fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042061 May 24 13:20:05.666202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 580/1153] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:06.677885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a94712ec-fcde-49be-a7a0-676a80bd5815 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:06.678749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a94712ec-fcde-49be-a7a0-676a80bd5815 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:06.685298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a94712ec-fcde-49be-a7a0-676a80bd5815 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:06.685747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a94712ec-fcde-49be-a7a0-676a80bd5815 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:06.686618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a94712ec-fcde-49be-a7a0-676a80bd5815 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:06.687055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a94712ec-fcde-49be-a7a0-676a80bd5815 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:06.723238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a94712ec-fcde-49be-a7a0-676a80bd5815 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049356 May 24 13:20:06.723805 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 574/1154] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:07.735424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-38d55966-0f0b-4a0c-900e-65bf8de3f175 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:07.736268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-38d55966-0f0b-4a0c-900e-65bf8de3f175 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:07.743099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38d55966-0f0b-4a0c-900e-65bf8de3f175 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:07.743550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38d55966-0f0b-4a0c-900e-65bf8de3f175 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:07.744304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38d55966-0f0b-4a0c-900e-65bf8de3f175 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:07.744737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38d55966-0f0b-4a0c-900e-65bf8de3f175 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:07.773359 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-38d55966-0f0b-4a0c-900e-65bf8de3f175 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042001 May 24 13:20:07.773897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 581/1155] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:08.785137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-56a0c911-ec3a-4be1-89d0-fd9a18b48bde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:08.786004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-56a0c911-ec3a-4be1-89d0-fd9a18b48bde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:08.792537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-56a0c911-ec3a-4be1-89d0-fd9a18b48bde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:08.792987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-56a0c911-ec3a-4be1-89d0-fd9a18b48bde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:08.793744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-56a0c911-ec3a-4be1-89d0-fd9a18b48bde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:08.794180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-56a0c911-ec3a-4be1-89d0-fd9a18b48bde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:08.822940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-56a0c911-ec3a-4be1-89d0-fd9a18b48bde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041849 May 24 13:20:08.823479 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 575/1156] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:09.835176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6aa18008-104b-4318-b747-5b4192537797 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:09.836109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6aa18008-104b-4318-b747-5b4192537797 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:09.843193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6aa18008-104b-4318-b747-5b4192537797 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:09.843651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6aa18008-104b-4318-b747-5b4192537797 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:09.844417 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6aa18008-104b-4318-b747-5b4192537797 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:09.844860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6aa18008-104b-4318-b747-5b4192537797 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:09.873732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6aa18008-104b-4318-b747-5b4192537797 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042606 May 24 13:20:09.874274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 582/1157] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:10.271810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:20:10.271988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:20:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:20:10.884981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4b2a07fd-79b1-4575-843d-206774b40af9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:10.885905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4b2a07fd-79b1-4575-843d-206774b40af9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:10.892423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4b2a07fd-79b1-4575-843d-206774b40af9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:10.892871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4b2a07fd-79b1-4575-843d-206774b40af9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:10.893634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4b2a07fd-79b1-4575-843d-206774b40af9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:10.894069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4b2a07fd-79b1-4575-843d-206774b40af9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:10.924819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4b2a07fd-79b1-4575-843d-206774b40af9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043863 May 24 13:20:10.925455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 576/1158] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:11.936885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ee20d11a-f5bf-479a-ba85-b089e784ab0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:11.937818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ee20d11a-f5bf-479a-ba85-b089e784ab0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:11.944349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ee20d11a-f5bf-479a-ba85-b089e784ab0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:11.944799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ee20d11a-f5bf-479a-ba85-b089e784ab0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:11.945565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ee20d11a-f5bf-479a-ba85-b089e784ab0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:11.946004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ee20d11a-f5bf-479a-ba85-b089e784ab0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:11.977418 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ee20d11a-f5bf-479a-ba85-b089e784ab0b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044477 May 24 13:20:11.977998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 583/1159] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:12.989284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c8cf39a8-47c3-44fa-a88e-3e70c9d8fa92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:12.990203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c8cf39a8-47c3-44fa-a88e-3e70c9d8fa92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:12.997309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8cf39a8-47c3-44fa-a88e-3e70c9d8fa92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:12.997759 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8cf39a8-47c3-44fa-a88e-3e70c9d8fa92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:12.998551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8cf39a8-47c3-44fa-a88e-3e70c9d8fa92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:12.998990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8cf39a8-47c3-44fa-a88e-3e70c9d8fa92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:13.027896 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c8cf39a8-47c3-44fa-a88e-3e70c9d8fa92 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042856 May 24 13:20:13.028441 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 577/1160] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:14.039343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-785c8b1d-6ec7-45b5-b618-84bac815cd48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:14.040276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-785c8b1d-6ec7-45b5-b618-84bac815cd48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:14.046715 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-785c8b1d-6ec7-45b5-b618-84bac815cd48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:14.047167 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-785c8b1d-6ec7-45b5-b618-84bac815cd48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:14.047926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-785c8b1d-6ec7-45b5-b618-84bac815cd48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:14.048362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-785c8b1d-6ec7-45b5-b618-84bac815cd48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:14.077585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-785c8b1d-6ec7-45b5-b618-84bac815cd48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042197 May 24 13:20:14.078124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 584/1161] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:15.089158 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7e72cb73-66fd-41d8-a0b9-c44c733add44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:15.090089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7e72cb73-66fd-41d8-a0b9-c44c733add44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:15.096587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e72cb73-66fd-41d8-a0b9-c44c733add44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:15.097049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e72cb73-66fd-41d8-a0b9-c44c733add44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:15.097818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e72cb73-66fd-41d8-a0b9-c44c733add44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:15.098258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e72cb73-66fd-41d8-a0b9-c44c733add44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:15.128758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7e72cb73-66fd-41d8-a0b9-c44c733add44 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043618 May 24 13:20:15.129304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 578/1162] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:16.140667 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d11b17bb-8e76-4c6f-9d8b-126f28d2a8f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:16.141628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d11b17bb-8e76-4c6f-9d8b-126f28d2a8f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:16.148159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d11b17bb-8e76-4c6f-9d8b-126f28d2a8f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:16.148614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d11b17bb-8e76-4c6f-9d8b-126f28d2a8f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:16.149396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d11b17bb-8e76-4c6f-9d8b-126f28d2a8f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:16.149817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d11b17bb-8e76-4c6f-9d8b-126f28d2a8f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:16.178639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d11b17bb-8e76-4c6f-9d8b-126f28d2a8f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042548 May 24 13:20:16.179192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 585/1163] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:17.190185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-780755f7-70f6-4f35-b197-044390fb9fa7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:17.191149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-780755f7-70f6-4f35-b197-044390fb9fa7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:17.197644 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-780755f7-70f6-4f35-b197-044390fb9fa7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:17.198089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-780755f7-70f6-4f35-b197-044390fb9fa7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:17.199392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-780755f7-70f6-4f35-b197-044390fb9fa7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:17.199821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-780755f7-70f6-4f35-b197-044390fb9fa7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:17.228789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-780755f7-70f6-4f35-b197-044390fb9fa7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042603 May 24 13:20:17.229318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 579/1164] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:18.240012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c6dcbb18-be14-4fa9-9929-bf9e33523b38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:18.240943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c6dcbb18-be14-4fa9-9929-bf9e33523b38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:18.247880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6dcbb18-be14-4fa9-9929-bf9e33523b38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:18.248327 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6dcbb18-be14-4fa9-9929-bf9e33523b38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:18.249144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6dcbb18-be14-4fa9-9929-bf9e33523b38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:18.249583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6dcbb18-be14-4fa9-9929-bf9e33523b38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:18.279709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c6dcbb18-be14-4fa9-9929-bf9e33523b38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043878 May 24 13:20:18.280264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 586/1165] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:19.291352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b1357899-392d-47f6-9e99-a982b0d5a6bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:19.292197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b1357899-392d-47f6-9e99-a982b0d5a6bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:19.298323 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1357899-392d-47f6-9e99-a982b0d5a6bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:19.298775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1357899-392d-47f6-9e99-a982b0d5a6bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:19.299524 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1357899-392d-47f6-9e99-a982b0d5a6bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:19.299956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1357899-392d-47f6-9e99-a982b0d5a6bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:19.329983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b1357899-392d-47f6-9e99-a982b0d5a6bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042680 May 24 13:20:19.330571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 580/1166] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:20.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7e988015-a1ac-4416-a9b6-503cd0ad67d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:20.342785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7e988015-a1ac-4416-a9b6-503cd0ad67d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:20.349213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e988015-a1ac-4416-a9b6-503cd0ad67d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:20.349656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e988015-a1ac-4416-a9b6-503cd0ad67d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:20.350439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e988015-a1ac-4416-a9b6-503cd0ad67d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:20.350880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e988015-a1ac-4416-a9b6-503cd0ad67d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:20.379345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7e988015-a1ac-4416-a9b6-503cd0ad67d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042207 May 24 13:20:20.379876 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 587/1167] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:21.391117 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0dbcc1fb-f721-4f6f-b308-37936e0c9a5c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:21.392039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0dbcc1fb-f721-4f6f-b308-37936e0c9a5c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:21.398657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dbcc1fb-f721-4f6f-b308-37936e0c9a5c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:21.399103 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dbcc1fb-f721-4f6f-b308-37936e0c9a5c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:21.399852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dbcc1fb-f721-4f6f-b308-37936e0c9a5c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:21.400282 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dbcc1fb-f721-4f6f-b308-37936e0c9a5c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:21.430197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0dbcc1fb-f721-4f6f-b308-37936e0c9a5c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043037 May 24 13:20:21.430762 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 581/1168] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:22.441096 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3b20d179-9032-4422-8e92-c7e947c5f05b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:22.442053 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3b20d179-9032-4422-8e92-c7e947c5f05b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:22.448454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b20d179-9032-4422-8e92-c7e947c5f05b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:22.448898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b20d179-9032-4422-8e92-c7e947c5f05b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:22.449647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b20d179-9032-4422-8e92-c7e947c5f05b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:22.450077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3b20d179-9032-4422-8e92-c7e947c5f05b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:22.478472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3b20d179-9032-4422-8e92-c7e947c5f05b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041244 May 24 13:20:22.479014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 588/1169] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:23.490787 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-50ddf7dd-3cb3-4ca6-90f0-ad6afaab6d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:23.491734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-50ddf7dd-3cb3-4ca6-90f0-ad6afaab6d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:23.498904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50ddf7dd-3cb3-4ca6-90f0-ad6afaab6d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:23.499350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50ddf7dd-3cb3-4ca6-90f0-ad6afaab6d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:23.500097 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50ddf7dd-3cb3-4ca6-90f0-ad6afaab6d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:23.500526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50ddf7dd-3cb3-4ca6-90f0-ad6afaab6d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:23.529185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-50ddf7dd-3cb3-4ca6-90f0-ad6afaab6d8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042658 May 24 13:20:23.529719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 582/1170] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:24.540787 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-349d56fd-4411-4f89-bfca-d11338e86187 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:24.541720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-349d56fd-4411-4f89-bfca-d11338e86187 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:24.548792 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-349d56fd-4411-4f89-bfca-d11338e86187 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:24.549241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-349d56fd-4411-4f89-bfca-d11338e86187 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:24.550001 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-349d56fd-4411-4f89-bfca-d11338e86187 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:24.550477 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-349d56fd-4411-4f89-bfca-d11338e86187 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:24.578978 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-349d56fd-4411-4f89-bfca-d11338e86187 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042209 May 24 13:20:24.579519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 589/1171] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:25.590580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d9e99c4f-c6ec-43ff-a48c-20ed77d7110a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:25.591510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d9e99c4f-c6ec-43ff-a48c-20ed77d7110a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:25.597966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9e99c4f-c6ec-43ff-a48c-20ed77d7110a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:25.598451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9e99c4f-c6ec-43ff-a48c-20ed77d7110a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:25.599211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9e99c4f-c6ec-43ff-a48c-20ed77d7110a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:25.599650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9e99c4f-c6ec-43ff-a48c-20ed77d7110a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:25.629781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d9e99c4f-c6ec-43ff-a48c-20ed77d7110a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043260 May 24 13:20:25.630347 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 583/1172] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:26.641355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2b025188-9533-432f-baf0-403246d83fc0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:26.642301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2b025188-9533-432f-baf0-403246d83fc0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:26.644594 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:20:26.649937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b025188-9533-432f-baf0-403246d83fc0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:26.650421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b025188-9533-432f-baf0-403246d83fc0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:26.651755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b025188-9533-432f-baf0-403246d83fc0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:26.652196 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b025188-9533-432f-baf0-403246d83fc0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:26.655960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:20:26.681782 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2b025188-9533-432f-baf0-403246d83fc0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044419 May 24 13:20:26.682342 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 590/1173] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:27.693481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a8067a09-c20b-4840-8251-1bfd44b75e46 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:27.694345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a8067a09-c20b-4840-8251-1bfd44b75e46 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:27.696781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:20:27.702472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8067a09-c20b-4840-8251-1bfd44b75e46 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:27.702928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8067a09-c20b-4840-8251-1bfd44b75e46 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:27.703697 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8067a09-c20b-4840-8251-1bfd44b75e46 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:27.704133 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8067a09-c20b-4840-8251-1bfd44b75e46 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:27.707967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:20:27.733927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a8067a09-c20b-4840-8251-1bfd44b75e46 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044437 May 24 13:20:27.734506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 584/1174] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:28.746355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3d10fc9f-d3d9-4e11-a160-6465ab0e7877 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:28.747295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3d10fc9f-d3d9-4e11-a160-6465ab0e7877 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:28.753868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d10fc9f-d3d9-4e11-a160-6465ab0e7877 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:28.754334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d10fc9f-d3d9-4e11-a160-6465ab0e7877 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:28.755088 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d10fc9f-d3d9-4e11-a160-6465ab0e7877 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:28.755510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3d10fc9f-d3d9-4e11-a160-6465ab0e7877 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:28.786121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3d10fc9f-d3d9-4e11-a160-6465ab0e7877 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044339 May 24 13:20:28.786703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 591/1175] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:29.797774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-34166ca5-4209-4257-857e-4eff66336e94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:29.798632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-34166ca5-4209-4257-857e-4eff66336e94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:29.805140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34166ca5-4209-4257-857e-4eff66336e94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:29.805583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34166ca5-4209-4257-857e-4eff66336e94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:29.806411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34166ca5-4209-4257-857e-4eff66336e94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:29.806846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34166ca5-4209-4257-857e-4eff66336e94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:29.838218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-34166ca5-4209-4257-857e-4eff66336e94 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043890 May 24 13:20:29.838503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 585/1176] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:30.849109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c0be40f3-ddc8-49ca-9744-03c5fc3a9f45 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:30.850071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c0be40f3-ddc8-49ca-9744-03c5fc3a9f45 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:30.856526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0be40f3-ddc8-49ca-9744-03c5fc3a9f45 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:30.856974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0be40f3-ddc8-49ca-9744-03c5fc3a9f45 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:30.857736 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0be40f3-ddc8-49ca-9744-03c5fc3a9f45 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:30.858189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0be40f3-ddc8-49ca-9744-03c5fc3a9f45 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:30.887431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c0be40f3-ddc8-49ca-9744-03c5fc3a9f45 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042306 May 24 13:20:30.887975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 592/1177] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:31.898971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6996c7d6-fe0c-4d5c-a807-ea75d59487ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:31.900012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6996c7d6-fe0c-4d5c-a807-ea75d59487ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:31.906478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6996c7d6-fe0c-4d5c-a807-ea75d59487ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:31.906931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6996c7d6-fe0c-4d5c-a807-ea75d59487ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:31.907689 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6996c7d6-fe0c-4d5c-a807-ea75d59487ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:31.908126 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6996c7d6-fe0c-4d5c-a807-ea75d59487ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:31.937121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6996c7d6-fe0c-4d5c-a807-ea75d59487ed tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042108 May 24 13:20:31.937655 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 586/1178] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:32.948044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-22425f62-76f4-4cc8-981a-d73b687025b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:32.948971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-22425f62-76f4-4cc8-981a-d73b687025b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:32.955532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-22425f62-76f4-4cc8-981a-d73b687025b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:32.955988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-22425f62-76f4-4cc8-981a-d73b687025b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:32.956754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-22425f62-76f4-4cc8-981a-d73b687025b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:32.957199 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-22425f62-76f4-4cc8-981a-d73b687025b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:32.987085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-22425f62-76f4-4cc8-981a-d73b687025b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043301 May 24 13:20:32.987902 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 593/1179] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:34.000130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0bed4586-bf85-426c-8cc9-80abcc68e8ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:34.001039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0bed4586-bf85-426c-8cc9-80abcc68e8ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:34.007441 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bed4586-bf85-426c-8cc9-80abcc68e8ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:34.007881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bed4586-bf85-426c-8cc9-80abcc68e8ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:34.008632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bed4586-bf85-426c-8cc9-80abcc68e8ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:34.009063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bed4586-bf85-426c-8cc9-80abcc68e8ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:34.037909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0bed4586-bf85-426c-8cc9-80abcc68e8ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041712 May 24 13:20:34.038483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 587/1180] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:35.050228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5bc2a489-da35-400c-b2e4-b36ea0c5b96d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:35.051183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5bc2a489-da35-400c-b2e4-b36ea0c5b96d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:35.058515 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5bc2a489-da35-400c-b2e4-b36ea0c5b96d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:35.058972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5bc2a489-da35-400c-b2e4-b36ea0c5b96d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:35.059738 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5bc2a489-da35-400c-b2e4-b36ea0c5b96d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:35.060180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5bc2a489-da35-400c-b2e4-b36ea0c5b96d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:35.089255 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5bc2a489-da35-400c-b2e4-b36ea0c5b96d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043105 May 24 13:20:35.089793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 594/1181] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:36.100796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e0453a99-c621-42c2-af01-a1433a64802d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:36.101717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e0453a99-c621-42c2-af01-a1433a64802d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:36.108677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0453a99-c621-42c2-af01-a1433a64802d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:36.109119 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0453a99-c621-42c2-af01-a1433a64802d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:36.109872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0453a99-c621-42c2-af01-a1433a64802d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:36.110360 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0453a99-c621-42c2-af01-a1433a64802d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:36.140084 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e0453a99-c621-42c2-af01-a1433a64802d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043271 May 24 13:20:36.140629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 588/1182] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:37.151737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4f089022-4c03-4792-bfb7-29fc8c657a8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:37.152669 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4f089022-4c03-4792-bfb7-29fc8c657a8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:37.159173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f089022-4c03-4792-bfb7-29fc8c657a8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:37.159629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f089022-4c03-4792-bfb7-29fc8c657a8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:37.160397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f089022-4c03-4792-bfb7-29fc8c657a8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:37.160841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f089022-4c03-4792-bfb7-29fc8c657a8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:37.190808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4f089022-4c03-4792-bfb7-29fc8c657a8f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043050 May 24 13:20:37.191362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 595/1183] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:38.202453 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cb808750-a637-42bb-96a0-2fe595bdf296 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:38.203378 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cb808750-a637-42bb-96a0-2fe595bdf296 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:38.209928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb808750-a637-42bb-96a0-2fe595bdf296 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:38.210402 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb808750-a637-42bb-96a0-2fe595bdf296 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:38.211162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb808750-a637-42bb-96a0-2fe595bdf296 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:38.211597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb808750-a637-42bb-96a0-2fe595bdf296 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:38.241296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cb808750-a637-42bb-96a0-2fe595bdf296 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043377 May 24 13:20:38.241840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 589/1184] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:39.253013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-de5ea965-ffea-4904-aeba-fd4fe6f430e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:39.253976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-de5ea965-ffea-4904-aeba-fd4fe6f430e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:39.261461 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de5ea965-ffea-4904-aeba-fd4fe6f430e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:39.261918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de5ea965-ffea-4904-aeba-fd4fe6f430e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:39.262737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de5ea965-ffea-4904-aeba-fd4fe6f430e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:39.263184 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de5ea965-ffea-4904-aeba-fd4fe6f430e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:39.293008 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-de5ea965-ffea-4904-aeba-fd4fe6f430e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044025 May 24 13:20:39.293572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 596/1185] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:20:40.303889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-980692a9-0f57-490d-bd5a-46cfb63b041d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:40.304819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-980692a9-0f57-490d-bd5a-46cfb63b041d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:40.311375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-980692a9-0f57-490d-bd5a-46cfb63b041d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:40.311830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-980692a9-0f57-490d-bd5a-46cfb63b041d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:40.312611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-980692a9-0f57-490d-bd5a-46cfb63b041d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:40.313080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-980692a9-0f57-490d-bd5a-46cfb63b041d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:40.347967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-980692a9-0f57-490d-bd5a-46cfb63b041d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047995 May 24 13:20:40.348539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 590/1186] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:41.360342 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f4a8ad1e-2cb8-4efe-ac0d-9191b4fabe36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:41.361300 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f4a8ad1e-2cb8-4efe-ac0d-9191b4fabe36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:41.368062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f4a8ad1e-2cb8-4efe-ac0d-9191b4fabe36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:41.368519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f4a8ad1e-2cb8-4efe-ac0d-9191b4fabe36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:41.369284 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f4a8ad1e-2cb8-4efe-ac0d-9191b4fabe36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:41.370381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f4a8ad1e-2cb8-4efe-ac0d-9191b4fabe36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:41.399872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f4a8ad1e-2cb8-4efe-ac0d-9191b4fabe36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043444 May 24 13:20:41.400431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 597/1187] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:42.411903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c532b146-7f20-459e-ace5-15f91f4decfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:42.412870 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c532b146-7f20-459e-ace5-15f91f4decfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:42.419826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c532b146-7f20-459e-ace5-15f91f4decfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:42.420282 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c532b146-7f20-459e-ace5-15f91f4decfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:42.421042 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c532b146-7f20-459e-ace5-15f91f4decfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:42.421481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c532b146-7f20-459e-ace5-15f91f4decfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:42.450393 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c532b146-7f20-459e-ace5-15f91f4decfc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042499 May 24 13:20:42.450943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 591/1188] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:20:43.461429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ace35f41-35f3-450a-8c0b-79a5d8d28cd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:43.462383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ace35f41-35f3-450a-8c0b-79a5d8d28cd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:43.468885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ace35f41-35f3-450a-8c0b-79a5d8d28cd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:43.469337 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ace35f41-35f3-450a-8c0b-79a5d8d28cd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:43.470102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ace35f41-35f3-450a-8c0b-79a5d8d28cd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:43.470566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ace35f41-35f3-450a-8c0b-79a5d8d28cd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:43.500788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ace35f41-35f3-450a-8c0b-79a5d8d28cd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043363 May 24 13:20:43.501328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 598/1189] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:44.512528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-75a491ad-4be1-41e5-9cdb-b42dea504e80 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:44.513519 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-75a491ad-4be1-41e5-9cdb-b42dea504e80 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:44.520051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75a491ad-4be1-41e5-9cdb-b42dea504e80 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:44.520494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75a491ad-4be1-41e5-9cdb-b42dea504e80 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:44.521253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75a491ad-4be1-41e5-9cdb-b42dea504e80 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:44.521684 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75a491ad-4be1-41e5-9cdb-b42dea504e80 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:44.551045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-75a491ad-4be1-41e5-9cdb-b42dea504e80 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042538 May 24 13:20:44.551526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 592/1190] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:45.562998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ec6904b8-50ae-4060-803a-8a40a1ed13f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:45.563970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ec6904b8-50ae-4060-803a-8a40a1ed13f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:45.570547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec6904b8-50ae-4060-803a-8a40a1ed13f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:45.571003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec6904b8-50ae-4060-803a-8a40a1ed13f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:45.571757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec6904b8-50ae-4060-803a-8a40a1ed13f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:45.572191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec6904b8-50ae-4060-803a-8a40a1ed13f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:45.601064 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ec6904b8-50ae-4060-803a-8a40a1ed13f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042033 May 24 13:20:45.601600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 599/1191] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:46.612648 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7e579b85-20a5-450e-85a5-6e82e3c82c75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:46.613581 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7e579b85-20a5-450e-85a5-6e82e3c82c75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:46.620144 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e579b85-20a5-450e-85a5-6e82e3c82c75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:46.620596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e579b85-20a5-450e-85a5-6e82e3c82c75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:46.621355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e579b85-20a5-450e-85a5-6e82e3c82c75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:46.621789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e579b85-20a5-450e-85a5-6e82e3c82c75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:46.651370 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7e579b85-20a5-450e-85a5-6e82e3c82c75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042298 May 24 13:20:46.653067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 593/1192] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:47.663234 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5106d5e1-f5cf-482d-8085-2f77116f7d4b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:47.664092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5106d5e1-f5cf-482d-8085-2f77116f7d4b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:47.673791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5106d5e1-f5cf-482d-8085-2f77116f7d4b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:47.674237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5106d5e1-f5cf-482d-8085-2f77116f7d4b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:47.675029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5106d5e1-f5cf-482d-8085-2f77116f7d4b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:47.675475 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5106d5e1-f5cf-482d-8085-2f77116f7d4b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:47.703905 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5106d5e1-f5cf-482d-8085-2f77116f7d4b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044870 May 24 13:20:47.704459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 600/1193] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:48.715516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c845e6f7-663c-411e-882c-5800fc42a257 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:48.716356 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c845e6f7-663c-411e-882c-5800fc42a257 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:48.722607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c845e6f7-663c-411e-882c-5800fc42a257 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:48.723055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c845e6f7-663c-411e-882c-5800fc42a257 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:48.723806 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c845e6f7-663c-411e-882c-5800fc42a257 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:48.724237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c845e6f7-663c-411e-882c-5800fc42a257 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:48.754026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c845e6f7-663c-411e-882c-5800fc42a257 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042500 May 24 13:20:48.754607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 594/1194] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:49.765703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0bd85f06-1ccc-4b8b-9a6c-ef5d57edd778 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:49.766582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0bd85f06-1ccc-4b8b-9a6c-ef5d57edd778 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:49.773208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bd85f06-1ccc-4b8b-9a6c-ef5d57edd778 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:49.773663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bd85f06-1ccc-4b8b-9a6c-ef5d57edd778 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:49.774529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bd85f06-1ccc-4b8b-9a6c-ef5d57edd778 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:49.774977 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0bd85f06-1ccc-4b8b-9a6c-ef5d57edd778 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:49.804822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0bd85f06-1ccc-4b8b-9a6c-ef5d57edd778 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043238 May 24 13:20:49.805377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 601/1195] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:50.816482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e539706e-e3bf-4fed-af15-ff19818a7fc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:50.817408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e539706e-e3bf-4fed-af15-ff19818a7fc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:50.823957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e539706e-e3bf-4fed-af15-ff19818a7fc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:50.824409 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e539706e-e3bf-4fed-af15-ff19818a7fc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:50.825172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e539706e-e3bf-4fed-af15-ff19818a7fc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:50.825614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e539706e-e3bf-4fed-af15-ff19818a7fc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:50.855635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e539706e-e3bf-4fed-af15-ff19818a7fc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043061 May 24 13:20:50.856197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 595/1196] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:51.867389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7670abc0-2b83-438e-979c-d1d88f2ba206 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:51.868331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7670abc0-2b83-438e-979c-d1d88f2ba206 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:51.875424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7670abc0-2b83-438e-979c-d1d88f2ba206 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:51.875878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7670abc0-2b83-438e-979c-d1d88f2ba206 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:51.876641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7670abc0-2b83-438e-979c-d1d88f2ba206 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:51.877082 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7670abc0-2b83-438e-979c-d1d88f2ba206 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:51.905885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7670abc0-2b83-438e-979c-d1d88f2ba206 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042434 May 24 13:20:51.906478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 602/1197] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:52.917020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-69f6e855-c7f5-4199-941c-3ac4f02a6c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:52.917975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-69f6e855-c7f5-4199-941c-3ac4f02a6c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:52.924509 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69f6e855-c7f5-4199-941c-3ac4f02a6c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:52.924964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69f6e855-c7f5-4199-941c-3ac4f02a6c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:52.925734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69f6e855-c7f5-4199-941c-3ac4f02a6c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:52.926165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69f6e855-c7f5-4199-941c-3ac4f02a6c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:52.956327 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-69f6e855-c7f5-4199-941c-3ac4f02a6c41 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043234 May 24 13:20:52.957068 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 596/1198] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:53.968754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7812aaca-5121-4145-af68-50aa56e5bc99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:53.969623 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7812aaca-5121-4145-af68-50aa56e5bc99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:53.976255 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7812aaca-5121-4145-af68-50aa56e5bc99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:53.976732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7812aaca-5121-4145-af68-50aa56e5bc99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:53.977495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7812aaca-5121-4145-af68-50aa56e5bc99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:53.977936 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7812aaca-5121-4145-af68-50aa56e5bc99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:54.007342 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7812aaca-5121-4145-af68-50aa56e5bc99 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042820 May 24 13:20:54.007906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 603/1199] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:20:55.019644 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bdd27580-25e4-446a-8cbc-12cd60928c05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:55.020566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bdd27580-25e4-446a-8cbc-12cd60928c05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:55.028562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bdd27580-25e4-446a-8cbc-12cd60928c05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:55.029010 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bdd27580-25e4-446a-8cbc-12cd60928c05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:55.029772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bdd27580-25e4-446a-8cbc-12cd60928c05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:55.030207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bdd27580-25e4-446a-8cbc-12cd60928c05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:55.059727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bdd27580-25e4-446a-8cbc-12cd60928c05 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044051 May 24 13:20:55.060285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 597/1200] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:56.071884 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3897718d-bc91-4940-8b13-20495cda1fb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:56.073455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3897718d-bc91-4940-8b13-20495cda1fb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:56.079916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3897718d-bc91-4940-8b13-20495cda1fb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:56.080360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3897718d-bc91-4940-8b13-20495cda1fb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:56.081114 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3897718d-bc91-4940-8b13-20495cda1fb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:56.081544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3897718d-bc91-4940-8b13-20495cda1fb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:56.110645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3897718d-bc91-4940-8b13-20495cda1fb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042703 May 24 13:20:56.111212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 604/1201] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:57.122564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-077568f1-aec4-4cec-bcfa-f271f7e05b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:57.123489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-077568f1-aec4-4cec-bcfa-f271f7e05b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:57.129979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-077568f1-aec4-4cec-bcfa-f271f7e05b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:57.130462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-077568f1-aec4-4cec-bcfa-f271f7e05b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:57.131252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-077568f1-aec4-4cec-bcfa-f271f7e05b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:57.131688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-077568f1-aec4-4cec-bcfa-f271f7e05b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:57.162492 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-077568f1-aec4-4cec-bcfa-f271f7e05b25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043896 May 24 13:20:57.163052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 598/1202] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:58.173150 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f8dbad51-fa98-4e79-b35b-e8b6d0f20414 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:58.174068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f8dbad51-fa98-4e79-b35b-e8b6d0f20414 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:58.176421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:20:58.182672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8dbad51-fa98-4e79-b35b-e8b6d0f20414 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:58.183122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8dbad51-fa98-4e79-b35b-e8b6d0f20414 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:58.183872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8dbad51-fa98-4e79-b35b-e8b6d0f20414 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:58.184304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8dbad51-fa98-4e79-b35b-e8b6d0f20414 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:58.186921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:20:58.216654 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f8dbad51-fa98-4e79-b35b-e8b6d0f20414 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047450 May 24 13:20:58.217232 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 605/1203] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:58 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:20:59.228772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-453f8c4f-9778-4ccf-9cd2-9c6009aa5042 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:20:59.229745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-453f8c4f-9778-4ccf-9cd2-9c6009aa5042 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:20:59.232177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:20:59.238562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453f8c4f-9778-4ccf-9cd2-9c6009aa5042 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:59.239040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453f8c4f-9778-4ccf-9cd2-9c6009aa5042 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:59.239806 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453f8c4f-9778-4ccf-9cd2-9c6009aa5042 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:20:59.240320 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453f8c4f-9778-4ccf-9cd2-9c6009aa5042 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:20:59.242685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:20:59.271734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-453f8c4f-9778-4ccf-9cd2-9c6009aa5042 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047068 May 24 13:20:59.282648 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 599/1204] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:20:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:00.487588 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6c7ef180-a64e-47e7-96dd-73d8909dc8e9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:00.488464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6c7ef180-a64e-47e7-96dd-73d8909dc8e9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:00.495196 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c7ef180-a64e-47e7-96dd-73d8909dc8e9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:00.495655 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c7ef180-a64e-47e7-96dd-73d8909dc8e9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:00.496423 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c7ef180-a64e-47e7-96dd-73d8909dc8e9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:00.496865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c7ef180-a64e-47e7-96dd-73d8909dc8e9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:00.526813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6c7ef180-a64e-47e7-96dd-73d8909dc8e9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.247463 May 24 13:21:00.527366 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 606/1205] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:01.538155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-57b86c03-e739-440f-a552-6f49c11d2415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:01.539116 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-57b86c03-e739-440f-a552-6f49c11d2415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:01.545659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57b86c03-e739-440f-a552-6f49c11d2415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:01.546139 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57b86c03-e739-440f-a552-6f49c11d2415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:01.546921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57b86c03-e739-440f-a552-6f49c11d2415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:01.547351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57b86c03-e739-440f-a552-6f49c11d2415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:01.578165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-57b86c03-e739-440f-a552-6f49c11d2415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043993 May 24 13:21:01.578744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 600/1206] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:02.589423 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3ff07fc0-ff04-4b20-a2e7-17cff8a5861c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:02.590006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3ff07fc0-ff04-4b20-a2e7-17cff8a5861c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:02.596388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ff07fc0-ff04-4b20-a2e7-17cff8a5861c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:02.596836 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ff07fc0-ff04-4b20-a2e7-17cff8a5861c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:02.597593 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ff07fc0-ff04-4b20-a2e7-17cff8a5861c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:02.598035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ff07fc0-ff04-4b20-a2e7-17cff8a5861c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:02.628406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3ff07fc0-ff04-4b20-a2e7-17cff8a5861c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043335 May 24 13:21:02.628952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 607/1207] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:03.639849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d369f818-9196-4fb1-9205-b4f22ac21854 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:03.640852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d369f818-9196-4fb1-9205-b4f22ac21854 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:03.647464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d369f818-9196-4fb1-9205-b4f22ac21854 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:03.647910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d369f818-9196-4fb1-9205-b4f22ac21854 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:03.648670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d369f818-9196-4fb1-9205-b4f22ac21854 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:03.649607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d369f818-9196-4fb1-9205-b4f22ac21854 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:03.682629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d369f818-9196-4fb1-9205-b4f22ac21854 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046515 May 24 13:21:03.683699 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 601/1208] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:04.694666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-edb61040-ba1a-4150-93e9-009d4bbd20b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:04.695495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-edb61040-ba1a-4150-93e9-009d4bbd20b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:04.702484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edb61040-ba1a-4150-93e9-009d4bbd20b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:04.702943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edb61040-ba1a-4150-93e9-009d4bbd20b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:04.703703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edb61040-ba1a-4150-93e9-009d4bbd20b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:04.704141 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edb61040-ba1a-4150-93e9-009d4bbd20b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:04.733344 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-edb61040-ba1a-4150-93e9-009d4bbd20b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042733 May 24 13:21:04.733894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 608/1209] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:05.744891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1094c12e-d3fc-4f01-8e00-d917cc495b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:05.745932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1094c12e-d3fc-4f01-8e00-d917cc495b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:05.752433 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1094c12e-d3fc-4f01-8e00-d917cc495b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:05.752878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1094c12e-d3fc-4f01-8e00-d917cc495b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:05.753642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1094c12e-d3fc-4f01-8e00-d917cc495b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:05.754056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1094c12e-d3fc-4f01-8e00-d917cc495b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:05.782975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1094c12e-d3fc-4f01-8e00-d917cc495b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042022 May 24 13:21:05.783508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 602/1210] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:06.794513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c8b31bd4-27e7-42a1-8dca-d4771cac7645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:06.795452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c8b31bd4-27e7-42a1-8dca-d4771cac7645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:06.801903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8b31bd4-27e7-42a1-8dca-d4771cac7645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:06.802404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8b31bd4-27e7-42a1-8dca-d4771cac7645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:06.803176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8b31bd4-27e7-42a1-8dca-d4771cac7645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:06.803618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8b31bd4-27e7-42a1-8dca-d4771cac7645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:06.832570 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c8b31bd4-27e7-42a1-8dca-d4771cac7645 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041994 May 24 13:21:06.833055 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 609/1211] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:07.844460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-29f5edb5-2a9b-4bf1-877a-cea86339a15f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:07.845379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-29f5edb5-2a9b-4bf1-877a-cea86339a15f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:07.851874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29f5edb5-2a9b-4bf1-877a-cea86339a15f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:07.852315 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29f5edb5-2a9b-4bf1-877a-cea86339a15f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:07.853066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29f5edb5-2a9b-4bf1-877a-cea86339a15f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:07.853496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29f5edb5-2a9b-4bf1-877a-cea86339a15f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:07.882840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-29f5edb5-2a9b-4bf1-877a-cea86339a15f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042279 May 24 13:21:07.883378 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 603/1212] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:08.894084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d7f997d1-ce01-4f8d-a117-17d0ddf11add tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:08.895046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d7f997d1-ce01-4f8d-a117-17d0ddf11add tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:08.901522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7f997d1-ce01-4f8d-a117-17d0ddf11add tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:08.901981 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7f997d1-ce01-4f8d-a117-17d0ddf11add tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:08.902775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7f997d1-ce01-4f8d-a117-17d0ddf11add tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:08.903215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7f997d1-ce01-4f8d-a117-17d0ddf11add tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:08.933468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d7f997d1-ce01-4f8d-a117-17d0ddf11add tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042639 May 24 13:21:08.934018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 610/1213] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:09.944823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f65a7295-43aa-4e21-b2e1-c01397e27fc7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:09.945750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f65a7295-43aa-4e21-b2e1-c01397e27fc7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:09.952979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f65a7295-43aa-4e21-b2e1-c01397e27fc7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:09.953436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f65a7295-43aa-4e21-b2e1-c01397e27fc7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:09.954199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f65a7295-43aa-4e21-b2e1-c01397e27fc7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:09.954755 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f65a7295-43aa-4e21-b2e1-c01397e27fc7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:09.983746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f65a7295-43aa-4e21-b2e1-c01397e27fc7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042795 May 24 13:21:09.984227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 604/1214] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:10.995606 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-94002aa8-5090-4e95-8629-d9d75d3ceac4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:10.996542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-94002aa8-5090-4e95-8629-d9d75d3ceac4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:11.003079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94002aa8-5090-4e95-8629-d9d75d3ceac4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:11.003532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94002aa8-5090-4e95-8629-d9d75d3ceac4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:11.004297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94002aa8-5090-4e95-8629-d9d75d3ceac4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:11.004735 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94002aa8-5090-4e95-8629-d9d75d3ceac4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:11.033802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-94002aa8-5090-4e95-8629-d9d75d3ceac4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042633 May 24 13:21:11.034363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 611/1215] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:12.044865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-06100504-ea97-44a0-8101-6b0625a50dba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:12.045787 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-06100504-ea97-44a0-8101-6b0625a50dba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:12.052273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06100504-ea97-44a0-8101-6b0625a50dba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:12.052722 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06100504-ea97-44a0-8101-6b0625a50dba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:12.053478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06100504-ea97-44a0-8101-6b0625a50dba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:12.053912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06100504-ea97-44a0-8101-6b0625a50dba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:12.082864 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-06100504-ea97-44a0-8101-6b0625a50dba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041898 May 24 13:21:12.083416 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 605/1216] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:13.094706 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-70f6e5da-feec-445d-a0e3-a2adc954d800 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:13.095566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-70f6e5da-feec-445d-a0e3-a2adc954d800 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:13.101921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-70f6e5da-feec-445d-a0e3-a2adc954d800 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:13.102402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-70f6e5da-feec-445d-a0e3-a2adc954d800 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:13.103157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-70f6e5da-feec-445d-a0e3-a2adc954d800 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:13.103591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-70f6e5da-feec-445d-a0e3-a2adc954d800 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:13.133141 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-70f6e5da-feec-445d-a0e3-a2adc954d800 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042402 May 24 13:21:13.133681 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 612/1217] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:14.144547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-31d2324e-6196-499d-87ee-0a9bbc49fedd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:14.145480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-31d2324e-6196-499d-87ee-0a9bbc49fedd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:14.152046 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31d2324e-6196-499d-87ee-0a9bbc49fedd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:14.152501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31d2324e-6196-499d-87ee-0a9bbc49fedd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:14.153294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31d2324e-6196-499d-87ee-0a9bbc49fedd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:14.153736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31d2324e-6196-499d-87ee-0a9bbc49fedd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:14.183980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-31d2324e-6196-499d-87ee-0a9bbc49fedd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043275 May 24 13:21:14.184500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 606/1218] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:15.195316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f8a843de-2e54-4a2d-b473-8ef725530d74 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:15.196251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f8a843de-2e54-4a2d-b473-8ef725530d74 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:15.203241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8a843de-2e54-4a2d-b473-8ef725530d74 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:15.203699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8a843de-2e54-4a2d-b473-8ef725530d74 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:15.204470 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8a843de-2e54-4a2d-b473-8ef725530d74 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:15.204913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8a843de-2e54-4a2d-b473-8ef725530d74 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:15.234115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f8a843de-2e54-4a2d-b473-8ef725530d74 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042708 May 24 13:21:15.234642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 613/1219] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:16.246044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-352951d7-7b11-48ce-b7ca-ee839c560127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:16.246989 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-352951d7-7b11-48ce-b7ca-ee839c560127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:16.253310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-352951d7-7b11-48ce-b7ca-ee839c560127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:16.253756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-352951d7-7b11-48ce-b7ca-ee839c560127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:16.254551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-352951d7-7b11-48ce-b7ca-ee839c560127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:16.254973 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-352951d7-7b11-48ce-b7ca-ee839c560127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:16.283786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-352951d7-7b11-48ce-b7ca-ee839c560127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042093 May 24 13:21:16.284261 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 607/1220] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:17.294233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-523fce94-9d18-427b-918f-c9bc5fe5a226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:17.295189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-523fce94-9d18-427b-918f-c9bc5fe5a226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:17.301213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-523fce94-9d18-427b-918f-c9bc5fe5a226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:17.301662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-523fce94-9d18-427b-918f-c9bc5fe5a226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:17.302459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-523fce94-9d18-427b-918f-c9bc5fe5a226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:17.302899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-523fce94-9d18-427b-918f-c9bc5fe5a226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:17.331779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-523fce94-9d18-427b-918f-c9bc5fe5a226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041533 May 24 13:21:17.332479 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 614/1221] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:18.344113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b10f64f3-8f18-4dc6-9e7a-71cca1660a66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:18.345038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b10f64f3-8f18-4dc6-9e7a-71cca1660a66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:18.351204 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b10f64f3-8f18-4dc6-9e7a-71cca1660a66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:18.351654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b10f64f3-8f18-4dc6-9e7a-71cca1660a66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:18.352423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b10f64f3-8f18-4dc6-9e7a-71cca1660a66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:18.352858 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b10f64f3-8f18-4dc6-9e7a-71cca1660a66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:18.381991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b10f64f3-8f18-4dc6-9e7a-71cca1660a66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041869 May 24 13:21:18.382498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 608/1222] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:19.393626 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9e4ded7b-b362-448f-9c87-31955cbb27a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:19.394611 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9e4ded7b-b362-448f-9c87-31955cbb27a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:19.401435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9e4ded7b-b362-448f-9c87-31955cbb27a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:19.401907 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9e4ded7b-b362-448f-9c87-31955cbb27a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:19.402709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9e4ded7b-b362-448f-9c87-31955cbb27a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:19.403159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9e4ded7b-b362-448f-9c87-31955cbb27a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:19.436582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9e4ded7b-b362-448f-9c87-31955cbb27a1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046771 May 24 13:21:19.437261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 615/1223] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:20.448014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a365c65f-91cf-483f-8bed-827a74c31ace tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:20.448885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a365c65f-91cf-483f-8bed-827a74c31ace tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:20.455516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a365c65f-91cf-483f-8bed-827a74c31ace tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:20.455970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a365c65f-91cf-483f-8bed-827a74c31ace tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:20.456735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a365c65f-91cf-483f-8bed-827a74c31ace tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:20.457174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a365c65f-91cf-483f-8bed-827a74c31ace tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:20.487532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a365c65f-91cf-483f-8bed-827a74c31ace tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043508 May 24 13:21:20.488079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 609/1224] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:21.499702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6501775a-f03a-4413-8302-e10f65d6f1f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:21.500774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6501775a-f03a-4413-8302-e10f65d6f1f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:21.507032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6501775a-f03a-4413-8302-e10f65d6f1f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:21.507481 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6501775a-f03a-4413-8302-e10f65d6f1f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:21.508248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6501775a-f03a-4413-8302-e10f65d6f1f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:21.508749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6501775a-f03a-4413-8302-e10f65d6f1f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:21.538339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6501775a-f03a-4413-8302-e10f65d6f1f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043031 May 24 13:21:21.538842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 616/1225] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:22.144544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62a42f11-deb6-4d7b-9d20-2dedcb497987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:22.145053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-62a42f11-deb6-4d7b-9d20-2dedcb497987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:22.152429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62a42f11-deb6-4d7b-9d20-2dedcb497987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:22.152878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62a42f11-deb6-4d7b-9d20-2dedcb497987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:22.153644 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62a42f11-deb6-4d7b-9d20-2dedcb497987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:22.154080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62a42f11-deb6-4d7b-9d20-2dedcb497987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:22.181134 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-62a42f11-deb6-4d7b-9d20-2dedcb497987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:21:22.203507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-df04ffa0-f106-4afe-b386-2cee3552ce19 req-0eb7fb04-ce40-4baa-9a4d-caddd06a6d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15306de-1c66-401f-ae12-53f104459b1c", "tag": "524d6600-0659-4974-99c6-9ad37f7062ae"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:21:22.213350 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-df04ffa0-f106-4afe-b386-2cee3552ce19 req-0eb7fb04-ce40-4baa-9a4d-caddd06a6d61 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:22.214630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-df04ffa0-f106-4afe-b386-2cee3552ce19 req-0eb7fb04-ce40-4baa-9a4d-caddd06a6d61 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:22.227455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-df04ffa0-f106-4afe-b386-2cee3552ce19 req-0eb7fb04-ce40-4baa-9a4d-caddd06a6d61 service nova] Creating event network-changed:524d6600-0659-4974-99c6-9ad37f7062ae for instance a15306de-1c66-401f-ae12-53f104459b1c on hv-cinder-84301 May 24 13:21:22.234684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-df04ffa0-f106-4afe-b386-2cee3552ce19 req-0eb7fb04-ce40-4baa-9a4d-caddd06a6d61 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091217 May 24 13:21:22.235747 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 617/1226] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:22.268405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-62a42f11-deb6-4d7b-9d20-2dedcb497987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 204 len: 0 microversion: 2.1 time: 0.127431 May 24 13:21:22.269324 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 610/1227] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:21:22 2022] DELETE /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:21:22.278765 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d7cda12b-eeab-4c39-85c5-e936265414aa tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:22.279509 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d7cda12b-eeab-4c39-85c5-e936265414aa tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:22.285866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7cda12b-eeab-4c39-85c5-e936265414aa tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:22.286343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7cda12b-eeab-4c39-85c5-e936265414aa tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:22.287118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7cda12b-eeab-4c39-85c5-e936265414aa tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:22.287559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d7cda12b-eeab-4c39-85c5-e936265414aa tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:22.550470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9cdcacb2-ae3a-459a-9511-de8b01a894c5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:22.551959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9cdcacb2-ae3a-459a-9511-de8b01a894c5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:22.556248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d7cda12b-eeab-4c39-85c5-e936265414aa tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:22.558587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cdcacb2-ae3a-459a-9511-de8b01a894c5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:22.559252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cdcacb2-ae3a-459a-9511-de8b01a894c5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:22.560215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cdcacb2-ae3a-459a-9511-de8b01a894c5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:22.560823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cdcacb2-ae3a-459a-9511-de8b01a894c5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:22.565482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d7cda12b-eeab-4c39-85c5-e936265414aa tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1578 microversion: 2.1 time: 0.291896 May 24 13:21:22.572136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 618/1228] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:22 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1578 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:22.594602 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9cdcacb2-ae3a-459a-9511-de8b01a894c5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048431 May 24 13:21:22.595952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 611/1229] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:23.583431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ea653d95-9d39-46b3-8547-f7433f148fb9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:23.584051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ea653d95-9d39-46b3-8547-f7433f148fb9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:23.591244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea653d95-9d39-46b3-8547-f7433f148fb9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:23.591602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea653d95-9d39-46b3-8547-f7433f148fb9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:23.592397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea653d95-9d39-46b3-8547-f7433f148fb9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:23.592802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea653d95-9d39-46b3-8547-f7433f148fb9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:23.607784 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-214707d1-2f8c-4ec7-85b4-17f63e7ad6cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:23.608840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-214707d1-2f8c-4ec7-85b4-17f63e7ad6cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:23.615866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-214707d1-2f8c-4ec7-85b4-17f63e7ad6cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:23.616401 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-214707d1-2f8c-4ec7-85b4-17f63e7ad6cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:23.617254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-214707d1-2f8c-4ec7-85b4-17f63e7ad6cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:23.617780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-214707d1-2f8c-4ec7-85b4-17f63e7ad6cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:23.652981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-214707d1-2f8c-4ec7-85b4-17f63e7ad6cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050027 May 24 13:21:23.653561 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 612/1230] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:23.679134 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ea653d95-9d39-46b3-8547-f7433f148fb9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:23.686630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ea653d95-9d39-46b3-8547-f7433f148fb9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1391 microversion: 2.1 time: 0.107028 May 24 13:21:23.687190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 619/1231] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:23 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1391 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:24.254952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-788ed293-e022-44c9-ac24-51420e736ae7 req-a89b9338-02bd-4bd5-b7af-0f46a4e15b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15306de-1c66-401f-ae12-53f104459b1c", "name": "network-vif-deleted", "tag": "524d6600-0659-4974-99c6-9ad37f7062ae"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:21:24.263595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-788ed293-e022-44c9-ac24-51420e736ae7 req-a89b9338-02bd-4bd5-b7af-0f46a4e15b1d service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:24.264038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-788ed293-e022-44c9-ac24-51420e736ae7 req-a89b9338-02bd-4bd5-b7af-0f46a4e15b1d service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:24.274795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-788ed293-e022-44c9-ac24-51420e736ae7 req-a89b9338-02bd-4bd5-b7af-0f46a4e15b1d service nova] Creating event network-vif-deleted:524d6600-0659-4974-99c6-9ad37f7062ae for instance a15306de-1c66-401f-ae12-53f104459b1c on hv-cinder-84301 May 24 13:21:24.281166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-788ed293-e022-44c9-ac24-51420e736ae7 req-a89b9338-02bd-4bd5-b7af-0f46a4e15b1d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028388 May 24 13:21:24.282032 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 613/1232] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:24.664521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1131dbed-0059-48b6-95b3-b8628b9275ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:24.665454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1131dbed-0059-48b6-95b3-b8628b9275ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:24.672442 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1131dbed-0059-48b6-95b3-b8628b9275ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:24.672897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1131dbed-0059-48b6-95b3-b8628b9275ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:24.673680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1131dbed-0059-48b6-95b3-b8628b9275ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:24.674105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1131dbed-0059-48b6-95b3-b8628b9275ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:24.703610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1131dbed-0059-48b6-95b3-b8628b9275ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042997 May 24 13:21:24.706329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 620/1233] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:24.706503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9460de18-ef33-481e-8372-ef8603c05235 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:24.706503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9460de18-ef33-481e-8372-ef8603c05235 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:24.711548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9460de18-ef33-481e-8372-ef8603c05235 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:24.711976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9460de18-ef33-481e-8372-ef8603c05235 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:24.712780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9460de18-ef33-481e-8372-ef8603c05235 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:24.713197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9460de18-ef33-481e-8372-ef8603c05235 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:24.830753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9460de18-ef33-481e-8372-ef8603c05235 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:24.833039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:21:24.840075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9460de18-ef33-481e-8372-ef8603c05235 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.140309 May 24 13:21:24.840667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 614/1234] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:24 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:21:25.715704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bfed7a36-a554-45fe-8f77-aa860877b653 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:25.716585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bfed7a36-a554-45fe-8f77-aa860877b653 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:25.723083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bfed7a36-a554-45fe-8f77-aa860877b653 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:25.723540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bfed7a36-a554-45fe-8f77-aa860877b653 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:25.724310 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bfed7a36-a554-45fe-8f77-aa860877b653 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:25.724754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bfed7a36-a554-45fe-8f77-aa860877b653 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:25.753940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bfed7a36-a554-45fe-8f77-aa860877b653 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042918 May 24 13:21:25.754509 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 621/1235] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:25.857179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-482c6258-4944-4a51-ab59-5c94ef703fc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:25.857788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-482c6258-4944-4a51-ab59-5c94ef703fc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:25.865563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-482c6258-4944-4a51-ab59-5c94ef703fc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:25.866009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-482c6258-4944-4a51-ab59-5c94ef703fc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:25.866803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-482c6258-4944-4a51-ab59-5c94ef703fc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:25.867235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-482c6258-4944-4a51-ab59-5c94ef703fc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:25.930011 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-482c6258-4944-4a51-ab59-5c94ef703fc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:25.938043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-482c6258-4944-4a51-ab59-5c94ef703fc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085120 May 24 13:21:25.938638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 615/1236] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:25 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:26.765207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-461e77f2-49b3-4e35-a5a5-d302c86f5f3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:26.766042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-461e77f2-49b3-4e35-a5a5-d302c86f5f3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:26.772904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-461e77f2-49b3-4e35-a5a5-d302c86f5f3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:26.773357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-461e77f2-49b3-4e35-a5a5-d302c86f5f3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:26.774142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-461e77f2-49b3-4e35-a5a5-d302c86f5f3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:26.774616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-461e77f2-49b3-4e35-a5a5-d302c86f5f3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:26.790569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:21:26.809137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-461e77f2-49b3-4e35-a5a5-d302c86f5f3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047874 May 24 13:21:26.809737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 622/1237] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:26.955168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6bb60f31-cb54-4bcf-a3e9-e6e6296de707 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:26.955787 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6bb60f31-cb54-4bcf-a3e9-e6e6296de707 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:26.962354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bb60f31-cb54-4bcf-a3e9-e6e6296de707 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:26.962809 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bb60f31-cb54-4bcf-a3e9-e6e6296de707 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:26.963634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bb60f31-cb54-4bcf-a3e9-e6e6296de707 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:26.964615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bb60f31-cb54-4bcf-a3e9-e6e6296de707 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:27.023798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6bb60f31-cb54-4bcf-a3e9-e6e6296de707 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:27.032014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6bb60f31-cb54-4bcf-a3e9-e6e6296de707 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080776 May 24 13:21:27.032584 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 616/1238] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:26 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:27.821212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-960f152b-1f96-40d8-b03e-0a222b865244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:27.822145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-960f152b-1f96-40d8-b03e-0a222b865244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:27.829239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-960f152b-1f96-40d8-b03e-0a222b865244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:27.829688 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-960f152b-1f96-40d8-b03e-0a222b865244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:27.830476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-960f152b-1f96-40d8-b03e-0a222b865244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:27.830911 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-960f152b-1f96-40d8-b03e-0a222b865244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:27.859879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-960f152b-1f96-40d8-b03e-0a222b865244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042958 May 24 13:21:27.860419 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 623/1239] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:28.047920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-22794c48-8681-4e7b-a383-5a491524672a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:28.048532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-22794c48-8681-4e7b-a383-5a491524672a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:28.054992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22794c48-8681-4e7b-a383-5a491524672a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:28.055438 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22794c48-8681-4e7b-a383-5a491524672a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:28.056204 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22794c48-8681-4e7b-a383-5a491524672a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:28.056637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22794c48-8681-4e7b-a383-5a491524672a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:28.117061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-22794c48-8681-4e7b-a383-5a491524672a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:28.125005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-22794c48-8681-4e7b-a383-5a491524672a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080929 May 24 13:21:28.125563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 617/1240] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:28 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:28.871657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ae4e4526-d5c7-42b7-ac40-fc777ba36655 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:28.872621 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ae4e4526-d5c7-42b7-ac40-fc777ba36655 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:28.874944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=38 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:21:28.880216 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae4e4526-d5c7-42b7-ac40-fc777ba36655 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:28.880669 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae4e4526-d5c7-42b7-ac40-fc777ba36655 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:28.881431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae4e4526-d5c7-42b7-ac40-fc777ba36655 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:28.881870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae4e4526-d5c7-42b7-ac40-fc777ba36655 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:28.911024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ae4e4526-d5c7-42b7-ac40-fc777ba36655 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043363 May 24 13:21:28.911573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 624/1241] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:29.141747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f90e768d-e53f-4b49-844e-f086d6629658 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:29.142387 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f90e768d-e53f-4b49-844e-f086d6629658 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:29.148848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f90e768d-e53f-4b49-844e-f086d6629658 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:29.149337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f90e768d-e53f-4b49-844e-f086d6629658 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:29.150051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f90e768d-e53f-4b49-844e-f086d6629658 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:29.150515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f90e768d-e53f-4b49-844e-f086d6629658 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:29.210946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f90e768d-e53f-4b49-844e-f086d6629658 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:29.219082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f90e768d-e53f-4b49-844e-f086d6629658 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081177 May 24 13:21:29.219643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 618/1242] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:29 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:29.922778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a2688cd2-44cb-4e3a-b201-40a1ae52b981 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:29.923709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a2688cd2-44cb-4e3a-b201-40a1ae52b981 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:29.930276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2688cd2-44cb-4e3a-b201-40a1ae52b981 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:29.930759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2688cd2-44cb-4e3a-b201-40a1ae52b981 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:29.931531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2688cd2-44cb-4e3a-b201-40a1ae52b981 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:29.931978 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2688cd2-44cb-4e3a-b201-40a1ae52b981 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:29.961462 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a2688cd2-44cb-4e3a-b201-40a1ae52b981 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042730 May 24 13:21:29.962029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 625/1243] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:30.236700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-392ef908-ec47-4dc0-99b1-c321251d5723 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:30.237320 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-392ef908-ec47-4dc0-99b1-c321251d5723 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:30.239597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:21:30.246104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-392ef908-ec47-4dc0-99b1-c321251d5723 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:30.246612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-392ef908-ec47-4dc0-99b1-c321251d5723 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:30.247375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-392ef908-ec47-4dc0-99b1-c321251d5723 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:30.247807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-392ef908-ec47-4dc0-99b1-c321251d5723 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:30.310836 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-392ef908-ec47-4dc0-99b1-c321251d5723 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:30.318531 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-392ef908-ec47-4dc0-99b1-c321251d5723 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.086010 May 24 13:21:30.319093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 619/1244] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:30 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:30.974111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e6d00dda-f191-4d81-b356-62ce5cb488ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:30.975102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e6d00dda-f191-4d81-b356-62ce5cb488ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:30.982244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e6d00dda-f191-4d81-b356-62ce5cb488ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:30.982729 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e6d00dda-f191-4d81-b356-62ce5cb488ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:30.983501 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e6d00dda-f191-4d81-b356-62ce5cb488ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:30.983944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e6d00dda-f191-4d81-b356-62ce5cb488ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:31.012595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e6d00dda-f191-4d81-b356-62ce5cb488ba tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042507 May 24 13:21:31.013137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 626/1245] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:31.336002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a887862d-3bd8-4add-b3e9-72d76120d89d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:31.336611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a887862d-3bd8-4add-b3e9-72d76120d89d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:31.343739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a887862d-3bd8-4add-b3e9-72d76120d89d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:31.344177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a887862d-3bd8-4add-b3e9-72d76120d89d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:31.344926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a887862d-3bd8-4add-b3e9-72d76120d89d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:31.345357 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a887862d-3bd8-4add-b3e9-72d76120d89d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:31.405178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a887862d-3bd8-4add-b3e9-72d76120d89d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:31.412958 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a887862d-3bd8-4add-b3e9-72d76120d89d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080841 May 24 13:21:31.413611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 620/1246] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:31 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:32.023399 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ae435c00-80fe-42e9-8722-a94afb1ba3e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:32.024348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ae435c00-80fe-42e9-8722-a94afb1ba3e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:32.030868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae435c00-80fe-42e9-8722-a94afb1ba3e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:32.031316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae435c00-80fe-42e9-8722-a94afb1ba3e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:32.032066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae435c00-80fe-42e9-8722-a94afb1ba3e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:32.032498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ae435c00-80fe-42e9-8722-a94afb1ba3e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:32.061290 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ae435c00-80fe-42e9-8722-a94afb1ba3e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041862 May 24 13:21:32.061828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 627/1247] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:32.429851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-67c67bb2-efdf-4cda-8c60-0b2b6b1bb9dd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:32.430568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-67c67bb2-efdf-4cda-8c60-0b2b6b1bb9dd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:32.437469 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67c67bb2-efdf-4cda-8c60-0b2b6b1bb9dd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:32.437976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67c67bb2-efdf-4cda-8c60-0b2b6b1bb9dd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:32.439206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67c67bb2-efdf-4cda-8c60-0b2b6b1bb9dd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:32.439649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67c67bb2-efdf-4cda-8c60-0b2b6b1bb9dd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:32.500283 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67c67bb2-efdf-4cda-8c60-0b2b6b1bb9dd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:32.507723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-67c67bb2-efdf-4cda-8c60-0b2b6b1bb9dd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081878 May 24 13:21:32.508284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 621/1248] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:32 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:33.072680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-30587959-4962-4037-942e-99a52a1bc6b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:33.073599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-30587959-4962-4037-942e-99a52a1bc6b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:33.080153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30587959-4962-4037-942e-99a52a1bc6b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:33.080601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30587959-4962-4037-942e-99a52a1bc6b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:33.081353 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30587959-4962-4037-942e-99a52a1bc6b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:33.081791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30587959-4962-4037-942e-99a52a1bc6b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:33.110701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-30587959-4962-4037-942e-99a52a1bc6b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041933 May 24 13:21:33.111246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 628/1249] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:33.525168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d3e5e9ea-7fd9-42bf-9008-437d9db79d4d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:33.526413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3e5e9ea-7fd9-42bf-9008-437d9db79d4d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:33.532806 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3e5e9ea-7fd9-42bf-9008-437d9db79d4d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:33.533249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3e5e9ea-7fd9-42bf-9008-437d9db79d4d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:33.533992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3e5e9ea-7fd9-42bf-9008-437d9db79d4d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:33.534451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3e5e9ea-7fd9-42bf-9008-437d9db79d4d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:33.601444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d3e5e9ea-7fd9-42bf-9008-437d9db79d4d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:33.609049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d3e5e9ea-7fd9-42bf-9008-437d9db79d4d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.087722 May 24 13:21:33.609609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 622/1250] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:33 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:34.122857 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-419e4a5b-eff8-48cd-88bd-5e82ea556cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:34.123792 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-419e4a5b-eff8-48cd-88bd-5e82ea556cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:34.130231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-419e4a5b-eff8-48cd-88bd-5e82ea556cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:34.130709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-419e4a5b-eff8-48cd-88bd-5e82ea556cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:34.131468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-419e4a5b-eff8-48cd-88bd-5e82ea556cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:34.131906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-419e4a5b-eff8-48cd-88bd-5e82ea556cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:34.161933 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-419e4a5b-eff8-48cd-88bd-5e82ea556cad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043589 May 24 13:21:34.162522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 629/1251] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:34.626707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-18d663b6-aee5-4576-a0d3-9e7c7289681d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:34.627357 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-18d663b6-aee5-4576-a0d3-9e7c7289681d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:34.633696 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18d663b6-aee5-4576-a0d3-9e7c7289681d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:34.634135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18d663b6-aee5-4576-a0d3-9e7c7289681d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:34.634915 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18d663b6-aee5-4576-a0d3-9e7c7289681d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:34.635367 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18d663b6-aee5-4576-a0d3-9e7c7289681d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:34.696972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-18d663b6-aee5-4576-a0d3-9e7c7289681d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:34.704971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-18d663b6-aee5-4576-a0d3-9e7c7289681d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082098 May 24 13:21:34.705526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 623/1252] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:34 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:35.173617 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c8b4744c-b523-418c-8f9d-165a1561e7a4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:35.174558 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c8b4744c-b523-418c-8f9d-165a1561e7a4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:35.180730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8b4744c-b523-418c-8f9d-165a1561e7a4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:35.181174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8b4744c-b523-418c-8f9d-165a1561e7a4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:35.181925 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8b4744c-b523-418c-8f9d-165a1561e7a4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:35.183015 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c8b4744c-b523-418c-8f9d-165a1561e7a4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:35.212299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c8b4744c-b523-418c-8f9d-165a1561e7a4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042291 May 24 13:21:35.213303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 630/1253] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:35.722374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-84bc6e6f-9d2c-4dc2-91ca-e128a6f3aef6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:35.722991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-84bc6e6f-9d2c-4dc2-91ca-e128a6f3aef6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:35.730031 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84bc6e6f-9d2c-4dc2-91ca-e128a6f3aef6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:35.730510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84bc6e6f-9d2c-4dc2-91ca-e128a6f3aef6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:35.731299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84bc6e6f-9d2c-4dc2-91ca-e128a6f3aef6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:35.731732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84bc6e6f-9d2c-4dc2-91ca-e128a6f3aef6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:35.793493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-84bc6e6f-9d2c-4dc2-91ca-e128a6f3aef6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:35.801080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-84bc6e6f-9d2c-4dc2-91ca-e128a6f3aef6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082575 May 24 13:21:35.801640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 624/1254] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:35 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:36.226002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1ed152fb-c742-4695-945d-d4b4c8144197 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:36.226963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1ed152fb-c742-4695-945d-d4b4c8144197 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:36.233434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ed152fb-c742-4695-945d-d4b4c8144197 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:36.233891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ed152fb-c742-4695-945d-d4b4c8144197 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:36.234693 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ed152fb-c742-4695-945d-d4b4c8144197 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:36.235133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ed152fb-c742-4695-945d-d4b4c8144197 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:36.264859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1ed152fb-c742-4695-945d-d4b4c8144197 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042810 May 24 13:21:36.265402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 631/1255] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:36.818027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-270ce2ef-1a0d-4586-a132-f1ceca730cf2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:36.818672 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-270ce2ef-1a0d-4586-a132-f1ceca730cf2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:36.825676 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-270ce2ef-1a0d-4586-a132-f1ceca730cf2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:36.826127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-270ce2ef-1a0d-4586-a132-f1ceca730cf2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:36.826924 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-270ce2ef-1a0d-4586-a132-f1ceca730cf2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:36.827361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-270ce2ef-1a0d-4586-a132-f1ceca730cf2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:36.886422 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-270ce2ef-1a0d-4586-a132-f1ceca730cf2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:36.893857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-270ce2ef-1a0d-4586-a132-f1ceca730cf2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079672 May 24 13:21:36.894454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 625/1256] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:36 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:37.276544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bbe39ea9-f5d9-4c3d-8b34-2dace109b2e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:37.277386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bbe39ea9-f5d9-4c3d-8b34-2dace109b2e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:37.283883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bbe39ea9-f5d9-4c3d-8b34-2dace109b2e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:37.284334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bbe39ea9-f5d9-4c3d-8b34-2dace109b2e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:37.285122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bbe39ea9-f5d9-4c3d-8b34-2dace109b2e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:37.285558 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bbe39ea9-f5d9-4c3d-8b34-2dace109b2e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:37.314569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bbe39ea9-f5d9-4c3d-8b34-2dace109b2e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042069 May 24 13:21:37.315107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 632/1257] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:37.911529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7bb4e151-bb16-4c63-afa1-f3717d84f1b3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:37.912142 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7bb4e151-bb16-4c63-afa1-f3717d84f1b3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:37.918623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bb4e151-bb16-4c63-afa1-f3717d84f1b3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:37.919069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bb4e151-bb16-4c63-afa1-f3717d84f1b3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:37.920463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bb4e151-bb16-4c63-afa1-f3717d84f1b3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:37.920928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bb4e151-bb16-4c63-afa1-f3717d84f1b3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:37.980804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7bb4e151-bb16-4c63-afa1-f3717d84f1b3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:37.989270 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7bb4e151-bb16-4c63-afa1-f3717d84f1b3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081606 May 24 13:21:37.989832 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 626/1258] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:37 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:38.326615 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-113ac0e3-a825-4f4c-9ebd-d43be9102bd8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:38.327566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-113ac0e3-a825-4f4c-9ebd-d43be9102bd8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:38.334059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-113ac0e3-a825-4f4c-9ebd-d43be9102bd8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:38.334554 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-113ac0e3-a825-4f4c-9ebd-d43be9102bd8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:38.335323 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-113ac0e3-a825-4f4c-9ebd-d43be9102bd8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:38.335769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-113ac0e3-a825-4f4c-9ebd-d43be9102bd8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:38.365375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-113ac0e3-a825-4f4c-9ebd-d43be9102bd8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043186 May 24 13:21:38.365976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 633/1259] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:39.006022 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-618de5c6-7b09-4c7b-adb5-78a5555c8030 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:39.006667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-618de5c6-7b09-4c7b-adb5-78a5555c8030 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:39.013111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-618de5c6-7b09-4c7b-adb5-78a5555c8030 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:39.013563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-618de5c6-7b09-4c7b-adb5-78a5555c8030 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:39.014338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-618de5c6-7b09-4c7b-adb5-78a5555c8030 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:39.014776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-618de5c6-7b09-4c7b-adb5-78a5555c8030 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:39.076779 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-618de5c6-7b09-4c7b-adb5-78a5555c8030 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:39.084186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-618de5c6-7b09-4c7b-adb5-78a5555c8030 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082035 May 24 13:21:39.084750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 627/1260] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:39 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:39.378111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-10eff9af-5f7f-4396-a4c6-d7d341e7efb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:39.379107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-10eff9af-5f7f-4396-a4c6-d7d341e7efb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:39.385602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10eff9af-5f7f-4396-a4c6-d7d341e7efb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:39.386064 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10eff9af-5f7f-4396-a4c6-d7d341e7efb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:39.386867 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10eff9af-5f7f-4396-a4c6-d7d341e7efb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:39.387307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10eff9af-5f7f-4396-a4c6-d7d341e7efb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:39.418777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-10eff9af-5f7f-4396-a4c6-d7d341e7efb3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045620 May 24 13:21:39.419339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 634/1261] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:40.101027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-de5fd42d-9d7e-4a8e-8fdc-71d86a25329a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:40.101651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-de5fd42d-9d7e-4a8e-8fdc-71d86a25329a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:40.108223 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de5fd42d-9d7e-4a8e-8fdc-71d86a25329a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:40.108711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de5fd42d-9d7e-4a8e-8fdc-71d86a25329a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:40.109450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de5fd42d-9d7e-4a8e-8fdc-71d86a25329a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:40.109875 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de5fd42d-9d7e-4a8e-8fdc-71d86a25329a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:40.169383 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-de5fd42d-9d7e-4a8e-8fdc-71d86a25329a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:40.176872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-de5fd42d-9d7e-4a8e-8fdc-71d86a25329a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079707 May 24 13:21:40.177432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 628/1262] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:40 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:40.431458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dd301361-d798-409a-bad4-286210c9b447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:40.432374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dd301361-d798-409a-bad4-286210c9b447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:40.439501 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd301361-d798-409a-bad4-286210c9b447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:40.439947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd301361-d798-409a-bad4-286210c9b447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:40.440696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd301361-d798-409a-bad4-286210c9b447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:40.441125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd301361-d798-409a-bad4-286210c9b447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:40.470723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dd301361-d798-409a-bad4-286210c9b447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043330 May 24 13:21:40.471267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 635/1263] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:40.921187 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:21:40.921457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:21:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:21:41.194256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-15c35af8-16c3-45be-90d9-2df6b2c7572f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:41.194918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-15c35af8-16c3-45be-90d9-2df6b2c7572f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:41.201928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15c35af8-16c3-45be-90d9-2df6b2c7572f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:41.202418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15c35af8-16c3-45be-90d9-2df6b2c7572f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:41.203176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15c35af8-16c3-45be-90d9-2df6b2c7572f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:41.203613 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15c35af8-16c3-45be-90d9-2df6b2c7572f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:41.262502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-15c35af8-16c3-45be-90d9-2df6b2c7572f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:41.270336 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-15c35af8-16c3-45be-90d9-2df6b2c7572f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080024 May 24 13:21:41.270892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 629/1264] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:41 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:41.482192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2ef0dc17-8ec4-4aff-8de0-69f3544c5966 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:41.483110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2ef0dc17-8ec4-4aff-8de0-69f3544c5966 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:41.489901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ef0dc17-8ec4-4aff-8de0-69f3544c5966 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:41.490376 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ef0dc17-8ec4-4aff-8de0-69f3544c5966 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:41.491133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ef0dc17-8ec4-4aff-8de0-69f3544c5966 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:41.491568 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ef0dc17-8ec4-4aff-8de0-69f3544c5966 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:41.527773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2ef0dc17-8ec4-4aff-8de0-69f3544c5966 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049539 May 24 13:21:41.528343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 636/1265] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:42.287276 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d7c091d-2173-40e6-933d-cd14653de353 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:42.287893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d7c091d-2173-40e6-933d-cd14653de353 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:42.294521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d7c091d-2173-40e6-933d-cd14653de353 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:42.294975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d7c091d-2173-40e6-933d-cd14653de353 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:42.296330 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d7c091d-2173-40e6-933d-cd14653de353 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:42.296769 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d7c091d-2173-40e6-933d-cd14653de353 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:42.355373 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d7c091d-2173-40e6-933d-cd14653de353 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:42.363737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d7c091d-2173-40e6-933d-cd14653de353 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080390 May 24 13:21:42.364298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 630/1266] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:42 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:42.539583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3421defc-6537-4eeb-9752-04115f65bb00 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:42.540993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3421defc-6537-4eeb-9752-04115f65bb00 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:42.548224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3421defc-6537-4eeb-9752-04115f65bb00 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:42.548680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3421defc-6537-4eeb-9752-04115f65bb00 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:42.549447 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3421defc-6537-4eeb-9752-04115f65bb00 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:42.549885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3421defc-6537-4eeb-9752-04115f65bb00 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:42.579079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3421defc-6537-4eeb-9752-04115f65bb00 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043784 May 24 13:21:42.579630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 637/1267] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:43.380535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2dc8f7e3-58dd-46f4-ad32-06eb1ce05492 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:43.381153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2dc8f7e3-58dd-46f4-ad32-06eb1ce05492 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:43.387771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dc8f7e3-58dd-46f4-ad32-06eb1ce05492 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:43.388227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dc8f7e3-58dd-46f4-ad32-06eb1ce05492 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:43.389006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dc8f7e3-58dd-46f4-ad32-06eb1ce05492 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:43.389447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dc8f7e3-58dd-46f4-ad32-06eb1ce05492 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:43.406335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:21:43.455730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2dc8f7e3-58dd-46f4-ad32-06eb1ce05492 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:43.463227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2dc8f7e3-58dd-46f4-ad32-06eb1ce05492 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.086545 May 24 13:21:43.463790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 631/1268] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:43 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:21:43.591062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3baefd10-d9f6-4ffd-9127-c96bb5174642 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:43.592517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3baefd10-d9f6-4ffd-9127-c96bb5174642 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:43.598995 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3baefd10-d9f6-4ffd-9127-c96bb5174642 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:43.599452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3baefd10-d9f6-4ffd-9127-c96bb5174642 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:43.600234 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3baefd10-d9f6-4ffd-9127-c96bb5174642 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:43.600675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3baefd10-d9f6-4ffd-9127-c96bb5174642 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:43.630572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3baefd10-d9f6-4ffd-9127-c96bb5174642 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043892 May 24 13:21:43.631143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 638/1269] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:44.479949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-463cbd13-af31-453a-80f5-84cf133b40d5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:44.480561 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-463cbd13-af31-453a-80f5-84cf133b40d5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:44.487388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-463cbd13-af31-453a-80f5-84cf133b40d5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:44.487829 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-463cbd13-af31-453a-80f5-84cf133b40d5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:44.488576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-463cbd13-af31-453a-80f5-84cf133b40d5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:44.489001 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-463cbd13-af31-453a-80f5-84cf133b40d5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:44.548525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-463cbd13-af31-453a-80f5-84cf133b40d5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:44.555851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-463cbd13-af31-453a-80f5-84cf133b40d5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079716 May 24 13:21:44.556406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 632/1270] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:44 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:44.641469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d4c1939c-3388-4df0-b824-cb2e2c90b13e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:44.642408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d4c1939c-3388-4df0-b824-cb2e2c90b13e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:44.648791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4c1939c-3388-4df0-b824-cb2e2c90b13e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:44.649233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4c1939c-3388-4df0-b824-cb2e2c90b13e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:44.649982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4c1939c-3388-4df0-b824-cb2e2c90b13e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:44.650445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4c1939c-3388-4df0-b824-cb2e2c90b13e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:44.653938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:21:44.678795 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d4c1939c-3388-4df0-b824-cb2e2c90b13e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041799 May 24 13:21:44.679335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 639/1271] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:45.575126 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3c96801b-4d65-440d-96a9-9298346ddc6f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:45.575765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c96801b-4d65-440d-96a9-9298346ddc6f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:45.583444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c96801b-4d65-440d-96a9-9298346ddc6f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:45.583882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c96801b-4d65-440d-96a9-9298346ddc6f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:45.584634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c96801b-4d65-440d-96a9-9298346ddc6f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:45.585067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c96801b-4d65-440d-96a9-9298346ddc6f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:45.645281 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3c96801b-4d65-440d-96a9-9298346ddc6f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:45.652764 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3c96801b-4d65-440d-96a9-9298346ddc6f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082216 May 24 13:21:45.653322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 633/1272] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:45 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:21:45.690801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e43885e6-5b3b-4ef4-a95a-7adbe8754b81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:45.691664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e43885e6-5b3b-4ef4-a95a-7adbe8754b81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:45.698068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e43885e6-5b3b-4ef4-a95a-7adbe8754b81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:45.698552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e43885e6-5b3b-4ef4-a95a-7adbe8754b81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:45.699313 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e43885e6-5b3b-4ef4-a95a-7adbe8754b81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:45.699752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e43885e6-5b3b-4ef4-a95a-7adbe8754b81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:45.728150 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e43885e6-5b3b-4ef4-a95a-7adbe8754b81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041336 May 24 13:21:45.728692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 640/1273] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:21:46.668923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cb7ed091-7475-4dd8-826d-a08ac60eb222 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:46.669541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cb7ed091-7475-4dd8-826d-a08ac60eb222 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:46.676668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb7ed091-7475-4dd8-826d-a08ac60eb222 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:46.677116 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb7ed091-7475-4dd8-826d-a08ac60eb222 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:46.677881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb7ed091-7475-4dd8-826d-a08ac60eb222 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:46.678335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb7ed091-7475-4dd8-826d-a08ac60eb222 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:46.738427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cb7ed091-7475-4dd8-826d-a08ac60eb222 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:46.740529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-02231c69-9088-46d5-b9d0-763fc2c09d4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:46.741455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-02231c69-9088-46d5-b9d0-763fc2c09d4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:46.745943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cb7ed091-7475-4dd8-826d-a08ac60eb222 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080922 May 24 13:21:46.746629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 634/1274] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:46 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:46.747438 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-02231c69-9088-46d5-b9d0-763fc2c09d4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:46.747950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-02231c69-9088-46d5-b9d0-763fc2c09d4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:46.748768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-02231c69-9088-46d5-b9d0-763fc2c09d4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:46.749206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-02231c69-9088-46d5-b9d0-763fc2c09d4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:46.778567 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-02231c69-9088-46d5-b9d0-763fc2c09d4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042498 May 24 13:21:46.779120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 641/1275] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:21:47.762819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fb8a4435-135c-4741-ac4c-db30b339b8a1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:47.763348 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fb8a4435-135c-4741-ac4c-db30b339b8a1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:47.769634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb8a4435-135c-4741-ac4c-db30b339b8a1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:47.770080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb8a4435-135c-4741-ac4c-db30b339b8a1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:47.770867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb8a4435-135c-4741-ac4c-db30b339b8a1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:47.771303 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb8a4435-135c-4741-ac4c-db30b339b8a1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:47.790580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a4ddc932-4000-4d5f-8675-62334fd0432d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:47.791501 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a4ddc932-4000-4d5f-8675-62334fd0432d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:47.798377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a4ddc932-4000-4d5f-8675-62334fd0432d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:47.798827 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a4ddc932-4000-4d5f-8675-62334fd0432d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:47.799588 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a4ddc932-4000-4d5f-8675-62334fd0432d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:47.800026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a4ddc932-4000-4d5f-8675-62334fd0432d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:47.830317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a4ddc932-4000-4d5f-8675-62334fd0432d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043605 May 24 13:21:47.831166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 642/1276] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:21:47.833328 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fb8a4435-135c-4741-ac4c-db30b339b8a1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:47.840936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fb8a4435-135c-4741-ac4c-db30b339b8a1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082110 May 24 13:21:47.841488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 635/1277] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:47 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:48.842581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d0741aa5-c95e-4a02-8830-9b352c570783 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:48.843517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d0741aa5-c95e-4a02-8830-9b352c570783 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:48.850149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0741aa5-c95e-4a02-8830-9b352c570783 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:48.851717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0741aa5-c95e-4a02-8830-9b352c570783 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:48.851717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0741aa5-c95e-4a02-8830-9b352c570783 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:48.851931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0741aa5-c95e-4a02-8830-9b352c570783 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:48.856688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-197e4aa6-8d9f-4373-a8dc-4430e0d3a893 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:48.857306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-197e4aa6-8d9f-4373-a8dc-4430e0d3a893 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:48.864224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-197e4aa6-8d9f-4373-a8dc-4430e0d3a893 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:48.864676 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-197e4aa6-8d9f-4373-a8dc-4430e0d3a893 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:48.865451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-197e4aa6-8d9f-4373-a8dc-4430e0d3a893 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:48.865884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-197e4aa6-8d9f-4373-a8dc-4430e0d3a893 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:48.882179 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d0741aa5-c95e-4a02-8830-9b352c570783 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044140 May 24 13:21:48.882779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 643/1278] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:48.937140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-197e4aa6-8d9f-4373-a8dc-4430e0d3a893 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:48.946484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-197e4aa6-8d9f-4373-a8dc-4430e0d3a893 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.091849 May 24 13:21:48.946484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 636/1279] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:48 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:21:49.894368 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-67460a98-fa75-465e-b1b9-e4b8baf11986 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:49.895292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-67460a98-fa75-465e-b1b9-e4b8baf11986 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:49.901671 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-67460a98-fa75-465e-b1b9-e4b8baf11986 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:49.902120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-67460a98-fa75-465e-b1b9-e4b8baf11986 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:49.902900 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-67460a98-fa75-465e-b1b9-e4b8baf11986 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:49.903334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-67460a98-fa75-465e-b1b9-e4b8baf11986 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:49.931489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-67460a98-fa75-465e-b1b9-e4b8baf11986 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041134 May 24 13:21:49.932018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 644/1280] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:49.962020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6dd0dfce-d2a1-4818-a60e-450340f86fa6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:49.962684 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6dd0dfce-d2a1-4818-a60e-450340f86fa6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:49.969080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6dd0dfce-d2a1-4818-a60e-450340f86fa6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:49.969529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6dd0dfce-d2a1-4818-a60e-450340f86fa6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:49.970303 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6dd0dfce-d2a1-4818-a60e-450340f86fa6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:49.970746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6dd0dfce-d2a1-4818-a60e-450340f86fa6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:50.030159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6dd0dfce-d2a1-4818-a60e-450340f86fa6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:50.037498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6dd0dfce-d2a1-4818-a60e-450340f86fa6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079314 May 24 13:21:50.038057 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 637/1281] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:49 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:50.943153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-342805e3-da3e-4bca-8f2e-fafe241468e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:50.944078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-342805e3-da3e-4bca-8f2e-fafe241468e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:50.950547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-342805e3-da3e-4bca-8f2e-fafe241468e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:50.951006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-342805e3-da3e-4bca-8f2e-fafe241468e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:50.952281 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-342805e3-da3e-4bca-8f2e-fafe241468e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:50.952723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-342805e3-da3e-4bca-8f2e-fafe241468e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:50.981932 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-342805e3-da3e-4bca-8f2e-fafe241468e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042749 May 24 13:21:50.982507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 645/1282] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:51.054962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-90ad9a97-cb12-46fb-a534-7569f2e5d06b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:51.055578 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-90ad9a97-cb12-46fb-a534-7569f2e5d06b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:51.062108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90ad9a97-cb12-46fb-a534-7569f2e5d06b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:51.062590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90ad9a97-cb12-46fb-a534-7569f2e5d06b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:51.063349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90ad9a97-cb12-46fb-a534-7569f2e5d06b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:51.063783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90ad9a97-cb12-46fb-a534-7569f2e5d06b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:51.125404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-90ad9a97-cb12-46fb-a534-7569f2e5d06b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:51.132917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-90ad9a97-cb12-46fb-a534-7569f2e5d06b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081790 May 24 13:21:51.133470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 638/1283] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:51 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:21:51.993385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-69ad5633-d69e-4b16-9d48-37ecbc472e48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:51.994323 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-69ad5633-d69e-4b16-9d48-37ecbc472e48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:52.000704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-69ad5633-d69e-4b16-9d48-37ecbc472e48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:52.001154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-69ad5633-d69e-4b16-9d48-37ecbc472e48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:52.001908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-69ad5633-d69e-4b16-9d48-37ecbc472e48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:52.002373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-69ad5633-d69e-4b16-9d48-37ecbc472e48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:52.031101 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-69ad5633-d69e-4b16-9d48-37ecbc472e48 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041361 May 24 13:21:52.031937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 646/1284] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:52.150210 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-03f28781-ccfd-4b2b-bc73-a30642ed4011 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:52.150869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-03f28781-ccfd-4b2b-bc73-a30642ed4011 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:52.157827 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03f28781-ccfd-4b2b-bc73-a30642ed4011 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:52.158276 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03f28781-ccfd-4b2b-bc73-a30642ed4011 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:52.159057 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03f28781-ccfd-4b2b-bc73-a30642ed4011 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:52.159495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03f28781-ccfd-4b2b-bc73-a30642ed4011 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:52.221701 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-03f28781-ccfd-4b2b-bc73-a30642ed4011 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:52.229277 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-03f28781-ccfd-4b2b-bc73-a30642ed4011 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082926 May 24 13:21:52.229837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 639/1285] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:52 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:53.043074 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-59e3666a-eab5-4412-a088-6e0b3d62ea31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:53.044003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-59e3666a-eab5-4412-a088-6e0b3d62ea31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:53.051188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59e3666a-eab5-4412-a088-6e0b3d62ea31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:53.051640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59e3666a-eab5-4412-a088-6e0b3d62ea31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:53.052402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59e3666a-eab5-4412-a088-6e0b3d62ea31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:53.052839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59e3666a-eab5-4412-a088-6e0b3d62ea31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:53.082131 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-59e3666a-eab5-4412-a088-6e0b3d62ea31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042939 May 24 13:21:53.082642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 647/1286] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:53.247115 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cafa268b-738b-4c7e-8cee-3b997795c20a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:53.247731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cafa268b-738b-4c7e-8cee-3b997795c20a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:53.254926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cafa268b-738b-4c7e-8cee-3b997795c20a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:53.255374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cafa268b-738b-4c7e-8cee-3b997795c20a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:53.256130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cafa268b-738b-4c7e-8cee-3b997795c20a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:53.256561 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cafa268b-738b-4c7e-8cee-3b997795c20a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:53.315558 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cafa268b-738b-4c7e-8cee-3b997795c20a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:53.323019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cafa268b-738b-4c7e-8cee-3b997795c20a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079791 May 24 13:21:53.323576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 640/1287] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:53 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:54.093731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-85351768-ff07-45ff-a6a9-150d003af7f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:54.094714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-85351768-ff07-45ff-a6a9-150d003af7f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:54.101339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-85351768-ff07-45ff-a6a9-150d003af7f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:54.101785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-85351768-ff07-45ff-a6a9-150d003af7f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:54.102571 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-85351768-ff07-45ff-a6a9-150d003af7f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:54.103002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-85351768-ff07-45ff-a6a9-150d003af7f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:54.132058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-85351768-ff07-45ff-a6a9-150d003af7f0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042952 May 24 13:21:54.132599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 648/1288] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:54.339835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9a60e656-acfc-454b-b084-8c05a9e878a2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:54.340452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9a60e656-acfc-454b-b084-8c05a9e878a2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:54.347063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a60e656-acfc-454b-b084-8c05a9e878a2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:54.347488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a60e656-acfc-454b-b084-8c05a9e878a2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:54.348252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a60e656-acfc-454b-b084-8c05a9e878a2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:54.348692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a60e656-acfc-454b-b084-8c05a9e878a2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:54.408665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9a60e656-acfc-454b-b084-8c05a9e878a2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:54.416296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9a60e656-acfc-454b-b084-8c05a9e878a2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080413 May 24 13:21:54.416862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 641/1289] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:54 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:55.143685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-64982e57-486d-4483-a38b-941fec18f226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:55.144602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-64982e57-486d-4483-a38b-941fec18f226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:55.151049 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64982e57-486d-4483-a38b-941fec18f226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:55.151495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64982e57-486d-4483-a38b-941fec18f226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:55.152248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64982e57-486d-4483-a38b-941fec18f226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:55.152676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64982e57-486d-4483-a38b-941fec18f226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:55.182197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-64982e57-486d-4483-a38b-941fec18f226 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042542 May 24 13:21:55.182750 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 649/1290] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:55.432916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f92a9d1a-07f3-4ea5-9604-57d4bd561a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:55.433521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f92a9d1a-07f3-4ea5-9604-57d4bd561a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:55.440030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f92a9d1a-07f3-4ea5-9604-57d4bd561a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:55.440468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f92a9d1a-07f3-4ea5-9604-57d4bd561a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:55.441223 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f92a9d1a-07f3-4ea5-9604-57d4bd561a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:55.441650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f92a9d1a-07f3-4ea5-9604-57d4bd561a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:55.501099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f92a9d1a-07f3-4ea5-9604-57d4bd561a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:55.509488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f92a9d1a-07f3-4ea5-9604-57d4bd561a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080478 May 24 13:21:55.510039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 642/1291] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:55 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:56.196122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3adca5aa-d156-4fe5-96db-98ce93f8ec81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:56.197494 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3adca5aa-d156-4fe5-96db-98ce93f8ec81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:56.206452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3adca5aa-d156-4fe5-96db-98ce93f8ec81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:56.206909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3adca5aa-d156-4fe5-96db-98ce93f8ec81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:56.207691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3adca5aa-d156-4fe5-96db-98ce93f8ec81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:56.208139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3adca5aa-d156-4fe5-96db-98ce93f8ec81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:56.244185 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3adca5aa-d156-4fe5-96db-98ce93f8ec81 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054395 May 24 13:21:56.244743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 650/1292] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:56.526912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-70dd2423-9b13-4e80-b54c-5433b4c73f4f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:56.527520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-70dd2423-9b13-4e80-b54c-5433b4c73f4f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:56.534518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70dd2423-9b13-4e80-b54c-5433b4c73f4f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:56.534962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70dd2423-9b13-4e80-b54c-5433b4c73f4f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:56.535712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70dd2423-9b13-4e80-b54c-5433b4c73f4f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:56.536138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70dd2423-9b13-4e80-b54c-5433b4c73f4f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:56.597834 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-70dd2423-9b13-4e80-b54c-5433b4c73f4f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:56.605276 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-70dd2423-9b13-4e80-b54c-5433b4c73f4f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082254 May 24 13:21:56.605769 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 643/1293] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:56 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:57.255870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-10289c07-8ebf-46c9-9c15-99987fa41447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:57.256788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-10289c07-8ebf-46c9-9c15-99987fa41447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:57.263250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10289c07-8ebf-46c9-9c15-99987fa41447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:57.263699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10289c07-8ebf-46c9-9c15-99987fa41447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:57.265098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10289c07-8ebf-46c9-9c15-99987fa41447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:57.265533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10289c07-8ebf-46c9-9c15-99987fa41447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:57.293733 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-10289c07-8ebf-46c9-9c15-99987fa41447 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041809 May 24 13:21:57.294206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 651/1294] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:57.623109 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-90c86d5d-25f5-4ef6-a6cd-302237235699 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:57.624349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-90c86d5d-25f5-4ef6-a6cd-302237235699 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:57.630799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90c86d5d-25f5-4ef6-a6cd-302237235699 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:57.631249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90c86d5d-25f5-4ef6-a6cd-302237235699 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:57.632013 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90c86d5d-25f5-4ef6-a6cd-302237235699 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:57.632452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90c86d5d-25f5-4ef6-a6cd-302237235699 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:57.694986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-90c86d5d-25f5-4ef6-a6cd-302237235699 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:57.702588 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-90c86d5d-25f5-4ef6-a6cd-302237235699 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083359 May 24 13:21:57.703143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 644/1295] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:57 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:58.305256 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c95732d7-3e38-4b73-871d-a32195cff4c0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:58.306534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c95732d7-3e38-4b73-871d-a32195cff4c0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:58.312999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c95732d7-3e38-4b73-871d-a32195cff4c0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:58.313457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c95732d7-3e38-4b73-871d-a32195cff4c0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:58.314227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c95732d7-3e38-4b73-871d-a32195cff4c0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:58.314700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c95732d7-3e38-4b73-871d-a32195cff4c0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:58.344602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c95732d7-3e38-4b73-871d-a32195cff4c0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043395 May 24 13:21:58.345157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 652/1296] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:58 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:58.719277 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a068249a-3c86-43e5-9bda-25fe68b053da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:58.719941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a068249a-3c86-43e5-9bda-25fe68b053da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:58.726474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a068249a-3c86-43e5-9bda-25fe68b053da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:58.726924 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a068249a-3c86-43e5-9bda-25fe68b053da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:58.727678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a068249a-3c86-43e5-9bda-25fe68b053da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:58.728108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a068249a-3c86-43e5-9bda-25fe68b053da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:58.787683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a068249a-3c86-43e5-9bda-25fe68b053da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:58.795132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a068249a-3c86-43e5-9bda-25fe68b053da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079719 May 24 13:21:58.795688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 645/1297] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:58 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:59.356146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-40cbf2e1-72e3-4f56-9395-db2bac362c4e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:59.357073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-40cbf2e1-72e3-4f56-9395-db2bac362c4e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:59.359960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=58 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:21:59.365529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-40cbf2e1-72e3-4f56-9395-db2bac362c4e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:59.365981 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-40cbf2e1-72e3-4f56-9395-db2bac362c4e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:59.366771 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-40cbf2e1-72e3-4f56-9395-db2bac362c4e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:59.367213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-40cbf2e1-72e3-4f56-9395-db2bac362c4e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:59.397223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-40cbf2e1-72e3-4f56-9395-db2bac362c4e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045130 May 24 13:21:59.397788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 653/1298] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:21:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:21:59.811872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-76717877-7da0-42a9-a867-6c1b1f35b55d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:21:59.812489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-76717877-7da0-42a9-a867-6c1b1f35b55d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:21:59.818951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-76717877-7da0-42a9-a867-6c1b1f35b55d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:59.819400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-76717877-7da0-42a9-a867-6c1b1f35b55d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:59.820159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-76717877-7da0-42a9-a867-6c1b1f35b55d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:21:59.820626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-76717877-7da0-42a9-a867-6c1b1f35b55d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:21:59.879992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-76717877-7da0-42a9-a867-6c1b1f35b55d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:21:59.887447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-76717877-7da0-42a9-a867-6c1b1f35b55d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079493 May 24 13:21:59.888005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 646/1299] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:21:59 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:21:59.996794 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:21:59.996963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:22:00.408952 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8b89603a-2b78-47bc-b8b0-dfc8c77e8fa6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:00.409886 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8b89603a-2b78-47bc-b8b0-dfc8c77e8fa6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:00.416418 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b89603a-2b78-47bc-b8b0-dfc8c77e8fa6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:00.416870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b89603a-2b78-47bc-b8b0-dfc8c77e8fa6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:00.417633 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b89603a-2b78-47bc-b8b0-dfc8c77e8fa6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:00.418069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8b89603a-2b78-47bc-b8b0-dfc8c77e8fa6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:00.447617 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8b89603a-2b78-47bc-b8b0-dfc8c77e8fa6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042648 May 24 13:22:00.448172 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 654/1300] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:00.904761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4bafbbc9-1649-47e3-83da-3ab77ed1bc83 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:00.905404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4bafbbc9-1649-47e3-83da-3ab77ed1bc83 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:00.908299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=56 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:22:00.913765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4bafbbc9-1649-47e3-83da-3ab77ed1bc83 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:00.914207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4bafbbc9-1649-47e3-83da-3ab77ed1bc83 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:00.914990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4bafbbc9-1649-47e3-83da-3ab77ed1bc83 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:00.915423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4bafbbc9-1649-47e3-83da-3ab77ed1bc83 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:00.977047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4bafbbc9-1649-47e3-83da-3ab77ed1bc83 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:00.985062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4bafbbc9-1649-47e3-83da-3ab77ed1bc83 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084279 May 24 13:22:00.985620 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 647/1301] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:00 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:01.459823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0871f7c0-a9f6-42d6-8b88-3014fbf9b5cb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:01.460744 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0871f7c0-a9f6-42d6-8b88-3014fbf9b5cb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:01.467194 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0871f7c0-a9f6-42d6-8b88-3014fbf9b5cb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:01.467638 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0871f7c0-a9f6-42d6-8b88-3014fbf9b5cb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:01.469429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0871f7c0-a9f6-42d6-8b88-3014fbf9b5cb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:01.469935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0871f7c0-a9f6-42d6-8b88-3014fbf9b5cb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:01.494185 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:22:01.499434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0871f7c0-a9f6-42d6-8b88-3014fbf9b5cb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043628 May 24 13:22:01.499980 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 655/1302] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:02.002607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aa993037-07de-4bf7-883b-ea714a8d6a2a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:02.003216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aa993037-07de-4bf7-883b-ea714a8d6a2a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:02.009591 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa993037-07de-4bf7-883b-ea714a8d6a2a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:02.010032 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa993037-07de-4bf7-883b-ea714a8d6a2a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:02.010816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa993037-07de-4bf7-883b-ea714a8d6a2a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:02.011247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa993037-07de-4bf7-883b-ea714a8d6a2a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:02.015113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:22:02.070702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-aa993037-07de-4bf7-883b-ea714a8d6a2a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:02.078120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aa993037-07de-4bf7-883b-ea714a8d6a2a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079971 May 24 13:22:02.078708 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 648/1303] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:01 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:02.511075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-62cba183-982e-4881-bbed-ecc71eed692b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:02.512001 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-62cba183-982e-4881-bbed-ecc71eed692b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:02.518810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62cba183-982e-4881-bbed-ecc71eed692b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:02.519262 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62cba183-982e-4881-bbed-ecc71eed692b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:02.520020 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62cba183-982e-4881-bbed-ecc71eed692b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:02.520458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62cba183-982e-4881-bbed-ecc71eed692b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:02.550598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-62cba183-982e-4881-bbed-ecc71eed692b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043478 May 24 13:22:02.551150 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 656/1304] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:03.095186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cf875790-3b5f-4c27-ac55-9a2e3423ee91 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:03.095783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cf875790-3b5f-4c27-ac55-9a2e3423ee91 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:03.102344 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf875790-3b5f-4c27-ac55-9a2e3423ee91 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:03.102729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf875790-3b5f-4c27-ac55-9a2e3423ee91 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:03.103480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf875790-3b5f-4c27-ac55-9a2e3423ee91 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:03.103909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf875790-3b5f-4c27-ac55-9a2e3423ee91 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:03.165304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cf875790-3b5f-4c27-ac55-9a2e3423ee91 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:03.172829 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cf875790-3b5f-4c27-ac55-9a2e3423ee91 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081650 May 24 13:22:03.173383 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 649/1305] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:03 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:03.562762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-953cf193-873c-4f27-8bf6-0327659addcd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:03.563689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-953cf193-873c-4f27-8bf6-0327659addcd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:03.570242 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-953cf193-873c-4f27-8bf6-0327659addcd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:03.570730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-953cf193-873c-4f27-8bf6-0327659addcd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:03.572426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-953cf193-873c-4f27-8bf6-0327659addcd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:03.572426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-953cf193-873c-4f27-8bf6-0327659addcd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:03.600355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-953cf193-873c-4f27-8bf6-0327659addcd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042195 May 24 13:22:03.600898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 657/1306] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:04.189731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-804fc0a0-14b7-44e1-914b-cc5e70a4101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:04.190382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-804fc0a0-14b7-44e1-914b-cc5e70a4101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:04.197009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-804fc0a0-14b7-44e1-914b-cc5e70a4101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:04.197461 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-804fc0a0-14b7-44e1-914b-cc5e70a4101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:04.198258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-804fc0a0-14b7-44e1-914b-cc5e70a4101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:04.198718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-804fc0a0-14b7-44e1-914b-cc5e70a4101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:04.258621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-804fc0a0-14b7-44e1-914b-cc5e70a4101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:04.266615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-804fc0a0-14b7-44e1-914b-cc5e70a4101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080751 May 24 13:22:04.267177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 650/1307] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:04 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:04.611817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cce6317e-ca62-4fff-85e6-b50d4befaf11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:04.612764 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cce6317e-ca62-4fff-85e6-b50d4befaf11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:04.619249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cce6317e-ca62-4fff-85e6-b50d4befaf11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:04.619695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cce6317e-ca62-4fff-85e6-b50d4befaf11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:04.620452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cce6317e-ca62-4fff-85e6-b50d4befaf11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:04.620889 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cce6317e-ca62-4fff-85e6-b50d4befaf11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:04.650094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cce6317e-ca62-4fff-85e6-b50d4befaf11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042561 May 24 13:22:04.650657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 658/1308] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:05.284172 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d81f3be-da7d-4939-ac1f-fd7ff8b3c56b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:05.284783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d81f3be-da7d-4939-ac1f-fd7ff8b3c56b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:05.291243 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d81f3be-da7d-4939-ac1f-fd7ff8b3c56b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:05.291690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d81f3be-da7d-4939-ac1f-fd7ff8b3c56b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:05.292457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d81f3be-da7d-4939-ac1f-fd7ff8b3c56b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:05.292888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d81f3be-da7d-4939-ac1f-fd7ff8b3c56b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:05.356664 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d81f3be-da7d-4939-ac1f-fd7ff8b3c56b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:05.364919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d81f3be-da7d-4939-ac1f-fd7ff8b3c56b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084696 May 24 13:22:05.365480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 651/1309] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:05 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:05.661186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9424895d-31fc-49f3-8db7-7bcf1242fa96 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:05.662104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9424895d-31fc-49f3-8db7-7bcf1242fa96 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:05.668511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9424895d-31fc-49f3-8db7-7bcf1242fa96 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:05.668960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9424895d-31fc-49f3-8db7-7bcf1242fa96 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:05.669714 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9424895d-31fc-49f3-8db7-7bcf1242fa96 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:05.670146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9424895d-31fc-49f3-8db7-7bcf1242fa96 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:05.699125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9424895d-31fc-49f3-8db7-7bcf1242fa96 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041948 May 24 13:22:05.699659 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 659/1310] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:06.381632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d920f070-5c32-4dd9-980c-ad9a6f7a6ff0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:06.382246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d920f070-5c32-4dd9-980c-ad9a6f7a6ff0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:06.388795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d920f070-5c32-4dd9-980c-ad9a6f7a6ff0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:06.389247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d920f070-5c32-4dd9-980c-ad9a6f7a6ff0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:06.390702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d920f070-5c32-4dd9-980c-ad9a6f7a6ff0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:06.391142 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d920f070-5c32-4dd9-980c-ad9a6f7a6ff0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:06.451707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d920f070-5c32-4dd9-980c-ad9a6f7a6ff0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:06.459749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d920f070-5c32-4dd9-980c-ad9a6f7a6ff0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082042 May 24 13:22:06.460318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 652/1311] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:06 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:06.711180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dd0dbe1c-c4b6-4257-bc66-6b0a588753d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:06.712014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dd0dbe1c-c4b6-4257-bc66-6b0a588753d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:06.718563 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd0dbe1c-c4b6-4257-bc66-6b0a588753d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:06.718998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd0dbe1c-c4b6-4257-bc66-6b0a588753d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:06.719754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd0dbe1c-c4b6-4257-bc66-6b0a588753d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:06.720187 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd0dbe1c-c4b6-4257-bc66-6b0a588753d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:06.750273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dd0dbe1c-c4b6-4257-bc66-6b0a588753d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042131 May 24 13:22:06.750836 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 660/1312] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:07.476935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-695d797c-5752-4eb9-9a6a-0c6de5ef9ff1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:07.477542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-695d797c-5752-4eb9-9a6a-0c6de5ef9ff1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:07.483969 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-695d797c-5752-4eb9-9a6a-0c6de5ef9ff1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:07.484411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-695d797c-5752-4eb9-9a6a-0c6de5ef9ff1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:07.485161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-695d797c-5752-4eb9-9a6a-0c6de5ef9ff1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:07.485592 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-695d797c-5752-4eb9-9a6a-0c6de5ef9ff1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:07.545392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-695d797c-5752-4eb9-9a6a-0c6de5ef9ff1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:07.552910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-695d797c-5752-4eb9-9a6a-0c6de5ef9ff1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080236 May 24 13:22:07.553476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 653/1313] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:07 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:22:07.761094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d05dcab0-aad5-4e18-a0be-7d9f9e1ed4fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:07.761948 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d05dcab0-aad5-4e18-a0be-7d9f9e1ed4fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:07.768994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d05dcab0-aad5-4e18-a0be-7d9f9e1ed4fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:07.769439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d05dcab0-aad5-4e18-a0be-7d9f9e1ed4fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:07.770192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d05dcab0-aad5-4e18-a0be-7d9f9e1ed4fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:07.770655 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d05dcab0-aad5-4e18-a0be-7d9f9e1ed4fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:07.799002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d05dcab0-aad5-4e18-a0be-7d9f9e1ed4fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041960 May 24 13:22:07.799542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 661/1314] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:08.570394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9d91876d-e3aa-46dc-b6d7-b6db239d3ca8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:08.571008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9d91876d-e3aa-46dc-b6d7-b6db239d3ca8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:08.577554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d91876d-e3aa-46dc-b6d7-b6db239d3ca8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:08.578113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d91876d-e3aa-46dc-b6d7-b6db239d3ca8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:08.578899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d91876d-e3aa-46dc-b6d7-b6db239d3ca8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:08.579458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d91876d-e3aa-46dc-b6d7-b6db239d3ca8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:08.639352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9d91876d-e3aa-46dc-b6d7-b6db239d3ca8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:08.646764 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9d91876d-e3aa-46dc-b6d7-b6db239d3ca8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080621 May 24 13:22:08.647329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 654/1315] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:08 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:08.810530 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-94a7dbef-3a29-4462-8675-5976f2d61077 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:08.811452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-94a7dbef-3a29-4462-8675-5976f2d61077 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:08.817812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94a7dbef-3a29-4462-8675-5976f2d61077 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:08.818257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94a7dbef-3a29-4462-8675-5976f2d61077 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:08.819039 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94a7dbef-3a29-4462-8675-5976f2d61077 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:08.819473 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94a7dbef-3a29-4462-8675-5976f2d61077 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:08.849820 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-94a7dbef-3a29-4462-8675-5976f2d61077 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043150 May 24 13:22:08.850321 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 662/1316] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:09.664049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-73783d3c-d61d-46b6-ad5a-c5ad8613f9e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:09.664580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-73783d3c-d61d-46b6-ad5a-c5ad8613f9e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:09.671009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73783d3c-d61d-46b6-ad5a-c5ad8613f9e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:09.671453 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73783d3c-d61d-46b6-ad5a-c5ad8613f9e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:09.672704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73783d3c-d61d-46b6-ad5a-c5ad8613f9e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:09.673133 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73783d3c-d61d-46b6-ad5a-c5ad8613f9e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:09.733773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-73783d3c-d61d-46b6-ad5a-c5ad8613f9e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:09.741899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-73783d3c-d61d-46b6-ad5a-c5ad8613f9e5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081771 May 24 13:22:09.742493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 655/1317] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:09 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:09.861718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-27c6a09c-f9a1-4add-8837-19a4cf299e1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:09.862672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-27c6a09c-f9a1-4add-8837-19a4cf299e1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:09.869154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-27c6a09c-f9a1-4add-8837-19a4cf299e1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:09.869602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-27c6a09c-f9a1-4add-8837-19a4cf299e1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:09.870453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-27c6a09c-f9a1-4add-8837-19a4cf299e1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:09.870891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-27c6a09c-f9a1-4add-8837-19a4cf299e1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:09.899314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-27c6a09c-f9a1-4add-8837-19a4cf299e1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042381 May 24 13:22:09.899860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 663/1318] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:10.759627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-687dc1b0-1923-43ef-bb3c-39045c7cdf10 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:10.760246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-687dc1b0-1923-43ef-bb3c-39045c7cdf10 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:10.767276 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-687dc1b0-1923-43ef-bb3c-39045c7cdf10 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:10.767719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-687dc1b0-1923-43ef-bb3c-39045c7cdf10 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:10.768481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-687dc1b0-1923-43ef-bb3c-39045c7cdf10 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:10.768907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-687dc1b0-1923-43ef-bb3c-39045c7cdf10 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:10.828151 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-687dc1b0-1923-43ef-bb3c-39045c7cdf10 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:10.835546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-687dc1b0-1923-43ef-bb3c-39045c7cdf10 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079896 May 24 13:22:10.836097 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 656/1319] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:10 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:22:10.910580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-04d2cff7-83eb-4e75-9a45-09b31aaac843 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:10.911534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-04d2cff7-83eb-4e75-9a45-09b31aaac843 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:10.917905 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04d2cff7-83eb-4e75-9a45-09b31aaac843 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:10.918404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04d2cff7-83eb-4e75-9a45-09b31aaac843 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:10.919168 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04d2cff7-83eb-4e75-9a45-09b31aaac843 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:10.919612 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04d2cff7-83eb-4e75-9a45-09b31aaac843 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:10.948388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-04d2cff7-83eb-4e75-9a45-09b31aaac843 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042293 May 24 13:22:10.948924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 664/1320] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:11.852869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-13c7583a-513d-4eaa-9bcd-82d6a32618f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:11.853518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-13c7583a-513d-4eaa-9bcd-82d6a32618f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:11.860974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13c7583a-513d-4eaa-9bcd-82d6a32618f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:11.861434 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13c7583a-513d-4eaa-9bcd-82d6a32618f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:11.862183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13c7583a-513d-4eaa-9bcd-82d6a32618f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:11.862637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13c7583a-513d-4eaa-9bcd-82d6a32618f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:11.924342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-13c7583a-513d-4eaa-9bcd-82d6a32618f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:11.931746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-13c7583a-513d-4eaa-9bcd-82d6a32618f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082731 May 24 13:22:11.932312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 657/1321] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:11 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:11.959815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-329e0828-d702-478e-9091-72d31b2438f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:11.960750 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-329e0828-d702-478e-9091-72d31b2438f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:11.967249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-329e0828-d702-478e-9091-72d31b2438f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:11.967704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-329e0828-d702-478e-9091-72d31b2438f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:11.968474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-329e0828-d702-478e-9091-72d31b2438f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:11.968919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-329e0828-d702-478e-9091-72d31b2438f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:11.998997 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-329e0828-d702-478e-9091-72d31b2438f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043156 May 24 13:22:11.999556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 665/1322] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:22:12.949098 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2673e13c-12ab-4530-adc3-3500fdeb5e07 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:12.949683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2673e13c-12ab-4530-adc3-3500fdeb5e07 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:12.956966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2673e13c-12ab-4530-adc3-3500fdeb5e07 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:12.957433 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2673e13c-12ab-4530-adc3-3500fdeb5e07 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:12.958186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2673e13c-12ab-4530-adc3-3500fdeb5e07 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:12.958648 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2673e13c-12ab-4530-adc3-3500fdeb5e07 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:13.011027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9b3ae5a5-dfee-4485-97b0-5c9d9a4518ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:13.012087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9b3ae5a5-dfee-4485-97b0-5c9d9a4518ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:13.018036 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2673e13c-12ab-4530-adc3-3500fdeb5e07 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:13.019425 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b3ae5a5-dfee-4485-97b0-5c9d9a4518ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:13.019890 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b3ae5a5-dfee-4485-97b0-5c9d9a4518ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:13.020677 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b3ae5a5-dfee-4485-97b0-5c9d9a4518ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:13.021121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b3ae5a5-dfee-4485-97b0-5c9d9a4518ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:13.025646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2673e13c-12ab-4530-adc3-3500fdeb5e07 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080373 May 24 13:22:13.026218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 658/1323] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:12 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:13.051613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9b3ae5a5-dfee-4485-97b0-5c9d9a4518ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044576 May 24 13:22:13.052165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 666/1324] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:22:14.042630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-67c7a83c-b109-42a3-8955-f8a90028991d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:14.043244 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-67c7a83c-b109-42a3-8955-f8a90028991d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:14.049709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67c7a83c-b109-42a3-8955-f8a90028991d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:14.050147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67c7a83c-b109-42a3-8955-f8a90028991d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:14.050933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67c7a83c-b109-42a3-8955-f8a90028991d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:14.051447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67c7a83c-b109-42a3-8955-f8a90028991d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:14.063132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-04be8208-10fb-47e9-a78d-3f67ea141b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:14.064080 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-04be8208-10fb-47e9-a78d-3f67ea141b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:14.070778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04be8208-10fb-47e9-a78d-3f67ea141b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:14.071265 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04be8208-10fb-47e9-a78d-3f67ea141b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:14.072035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04be8208-10fb-47e9-a78d-3f67ea141b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:14.072481 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04be8208-10fb-47e9-a78d-3f67ea141b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:14.103307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-04be8208-10fb-47e9-a78d-3f67ea141b8c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044077 May 24 13:22:14.103883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 667/1325] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:22:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:22:14.120321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67c7a83c-b109-42a3-8955-f8a90028991d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:14.127951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-67c7a83c-b109-42a3-8955-f8a90028991d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.089153 May 24 13:22:14.128507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 659/1326] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:14 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:15.115916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b35ce8e8-708d-470a-87d5-cc091fea9f1b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:22:15.116866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b35ce8e8-708d-470a-87d5-cc091fea9f1b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:15.123371 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b35ce8e8-708d-470a-87d5-cc091fea9f1b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:15.123823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b35ce8e8-708d-470a-87d5-cc091fea9f1b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:15.124618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b35ce8e8-708d-470a-87d5-cc091fea9f1b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:15.125058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b35ce8e8-708d-470a-87d5-cc091fea9f1b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:15.144507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62adccd1-2b9b-4c75-94b9-28761770c00c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:15.145203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-62adccd1-2b9b-4c75-94b9-28761770c00c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:15.152646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62adccd1-2b9b-4c75-94b9-28761770c00c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:15.153091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62adccd1-2b9b-4c75-94b9-28761770c00c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:15.153991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62adccd1-2b9b-4c75-94b9-28761770c00c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:15.154465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62adccd1-2b9b-4c75-94b9-28761770c00c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:15.196786 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b35ce8e8-708d-470a-87d5-cc091fea9f1b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/action" status: 200 len: 41348 microversion: 2.1 time: 0.084589 May 24 13:22:15.197739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 668/1327] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:22:15 2022] POST /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/action => generated 41348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:22:15.214913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-62adccd1-2b9b-4c75-94b9-28761770c00c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:15.223169 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-62adccd1-2b9b-4c75-94b9-28761770c00c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082452 May 24 13:22:15.223762 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 660/1328] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:15 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:22:16.241026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8a7ec116-378d-4842-b259-f233e7df44f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:16.241734 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8a7ec116-378d-4842-b259-f233e7df44f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:16.248921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a7ec116-378d-4842-b259-f233e7df44f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:16.249374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a7ec116-378d-4842-b259-f233e7df44f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:16.250771 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a7ec116-378d-4842-b259-f233e7df44f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:16.251209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a7ec116-378d-4842-b259-f233e7df44f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:16.311912 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8a7ec116-378d-4842-b259-f233e7df44f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:16.320039 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8a7ec116-378d-4842-b259-f233e7df44f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083212 May 24 13:22:16.320589 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 669/1329] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:16 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:17.336893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-04719a31-60d8-43e7-a572-2bbb0bed02e1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:17.337483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-04719a31-60d8-43e7-a572-2bbb0bed02e1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:17.344005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04719a31-60d8-43e7-a572-2bbb0bed02e1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:17.344452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04719a31-60d8-43e7-a572-2bbb0bed02e1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:17.345198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04719a31-60d8-43e7-a572-2bbb0bed02e1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:17.345638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04719a31-60d8-43e7-a572-2bbb0bed02e1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:17.405354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-04719a31-60d8-43e7-a572-2bbb0bed02e1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:17.413054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-04719a31-60d8-43e7-a572-2bbb0bed02e1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080057 May 24 13:22:17.413627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 661/1330] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:17 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:18.430111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7e0791f0-fb8b-4bf5-b582-756480b57e00 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:18.430759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7e0791f0-fb8b-4bf5-b582-756480b57e00 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:18.437248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e0791f0-fb8b-4bf5-b582-756480b57e00 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:18.437697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e0791f0-fb8b-4bf5-b582-756480b57e00 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:18.438540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e0791f0-fb8b-4bf5-b582-756480b57e00 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:18.438982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7e0791f0-fb8b-4bf5-b582-756480b57e00 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:18.503760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7e0791f0-fb8b-4bf5-b582-756480b57e00 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:18.511370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7e0791f0-fb8b-4bf5-b582-756480b57e00 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085106 May 24 13:22:18.511929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 670/1331] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:18 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:19.527777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-88284f8f-23c8-4c57-9833-d123f8d90c1c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:19.528501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-88284f8f-23c8-4c57-9833-d123f8d90c1c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:19.535503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88284f8f-23c8-4c57-9833-d123f8d90c1c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:19.535962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88284f8f-23c8-4c57-9833-d123f8d90c1c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:19.536729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88284f8f-23c8-4c57-9833-d123f8d90c1c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:19.537164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88284f8f-23c8-4c57-9833-d123f8d90c1c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:19.598392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-88284f8f-23c8-4c57-9833-d123f8d90c1c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:19.606509 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-88284f8f-23c8-4c57-9833-d123f8d90c1c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082569 May 24 13:22:19.607311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 662/1332] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:19 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:20.623576 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-93fda05e-c637-46fe-bb31-e0273f1acac1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:20.624224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-93fda05e-c637-46fe-bb31-e0273f1acac1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:20.630728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93fda05e-c637-46fe-bb31-e0273f1acac1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:20.631174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93fda05e-c637-46fe-bb31-e0273f1acac1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:20.631927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93fda05e-c637-46fe-bb31-e0273f1acac1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:20.632360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93fda05e-c637-46fe-bb31-e0273f1acac1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:20.945338 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-93fda05e-c637-46fe-bb31-e0273f1acac1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:20.952931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-93fda05e-c637-46fe-bb31-e0273f1acac1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.333173 May 24 13:22:20.953496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 671/1333] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:20 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:21.969751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9a7bd712-24f6-417a-8d77-960537f01f72 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:21.970411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9a7bd712-24f6-417a-8d77-960537f01f72 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:21.976945 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7bd712-24f6-417a-8d77-960537f01f72 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:21.977393 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7bd712-24f6-417a-8d77-960537f01f72 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:21.978148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7bd712-24f6-417a-8d77-960537f01f72 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:21.978611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7bd712-24f6-417a-8d77-960537f01f72 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:22.040390 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9a7bd712-24f6-417a-8d77-960537f01f72 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:22.047720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9a7bd712-24f6-417a-8d77-960537f01f72 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081920 May 24 13:22:22.048275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 663/1334] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:21 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:23.064990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ad59368d-0533-4bdc-9793-02b257831943 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:23.065601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ad59368d-0533-4bdc-9793-02b257831943 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:23.072062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad59368d-0533-4bdc-9793-02b257831943 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:23.072540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad59368d-0533-4bdc-9793-02b257831943 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:23.073320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad59368d-0533-4bdc-9793-02b257831943 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:23.073754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad59368d-0533-4bdc-9793-02b257831943 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:23.133533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ad59368d-0533-4bdc-9793-02b257831943 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:23.135837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:22:23.143250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ad59368d-0533-4bdc-9793-02b257831943 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082714 May 24 13:22:23.143808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 672/1335] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:23 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:24.160585 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3dc8e11d-fc50-47a7-9c06-60dc3f72b42b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:24.160995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3dc8e11d-fc50-47a7-9c06-60dc3f72b42b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:24.167541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dc8e11d-fc50-47a7-9c06-60dc3f72b42b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:24.167995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dc8e11d-fc50-47a7-9c06-60dc3f72b42b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:24.168766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dc8e11d-fc50-47a7-9c06-60dc3f72b42b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:24.169204 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dc8e11d-fc50-47a7-9c06-60dc3f72b42b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:24.231808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3dc8e11d-fc50-47a7-9c06-60dc3f72b42b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:24.233981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:22:24.241051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3dc8e11d-fc50-47a7-9c06-60dc3f72b42b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084613 May 24 13:22:24.241625 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 664/1336] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:24 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:25.258516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d701fffe-84e6-41e0-9713-dcbddfe5c405 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:25.259154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d701fffe-84e6-41e0-9713-dcbddfe5c405 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:25.265851 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d701fffe-84e6-41e0-9713-dcbddfe5c405 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:25.266321 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d701fffe-84e6-41e0-9713-dcbddfe5c405 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:25.267078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d701fffe-84e6-41e0-9713-dcbddfe5c405 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:25.267509 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d701fffe-84e6-41e0-9713-dcbddfe5c405 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:25.331463 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d701fffe-84e6-41e0-9713-dcbddfe5c405 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:25.338874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d701fffe-84e6-41e0-9713-dcbddfe5c405 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084284 May 24 13:22:25.339428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 673/1337] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:25 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:22:26.355796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7eb38e20-484f-44c5-8c1b-0590ac1c0f7f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:26.356410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7eb38e20-484f-44c5-8c1b-0590ac1c0f7f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:26.363296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7eb38e20-484f-44c5-8c1b-0590ac1c0f7f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:26.363750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7eb38e20-484f-44c5-8c1b-0590ac1c0f7f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:26.364516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7eb38e20-484f-44c5-8c1b-0590ac1c0f7f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:26.364955 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7eb38e20-484f-44c5-8c1b-0590ac1c0f7f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:26.426377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7eb38e20-484f-44c5-8c1b-0590ac1c0f7f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:26.433948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7eb38e20-484f-44c5-8c1b-0590ac1c0f7f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082235 May 24 13:22:26.434551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 665/1338] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:26 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:27.450706 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-571ece07-065b-44f4-9c0d-062f72e6f64b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:27.451316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-571ece07-065b-44f4-9c0d-062f72e6f64b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:27.458299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-571ece07-065b-44f4-9c0d-062f72e6f64b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:27.458747 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-571ece07-065b-44f4-9c0d-062f72e6f64b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:27.459498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-571ece07-065b-44f4-9c0d-062f72e6f64b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:27.459927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-571ece07-065b-44f4-9c0d-062f72e6f64b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:27.524294 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-571ece07-065b-44f4-9c0d-062f72e6f64b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:27.532574 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-571ece07-065b-44f4-9c0d-062f72e6f64b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085730 May 24 13:22:27.533127 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 674/1339] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:27 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:28.549847 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f427281a-3859-48a1-a441-444add3db578 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:28.550495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f427281a-3859-48a1-a441-444add3db578 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:28.556893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f427281a-3859-48a1-a441-444add3db578 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:28.557330 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f427281a-3859-48a1-a441-444add3db578 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:28.558076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f427281a-3859-48a1-a441-444add3db578 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:28.558533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f427281a-3859-48a1-a441-444add3db578 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:28.619178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f427281a-3859-48a1-a441-444add3db578 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:28.626576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f427281a-3859-48a1-a441-444add3db578 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081244 May 24 13:22:28.627147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 666/1340] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:28 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:29.643677 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1cf337e7-3050-48d4-ac8e-fc03117266e8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:29.644267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1cf337e7-3050-48d4-ac8e-fc03117266e8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:29.646556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=44 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:22:29.652171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1cf337e7-3050-48d4-ac8e-fc03117266e8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:29.652620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1cf337e7-3050-48d4-ac8e-fc03117266e8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:29.653370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1cf337e7-3050-48d4-ac8e-fc03117266e8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:29.653800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1cf337e7-3050-48d4-ac8e-fc03117266e8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:29.713108 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1cf337e7-3050-48d4-ac8e-fc03117266e8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:29.721083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1cf337e7-3050-48d4-ac8e-fc03117266e8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081800 May 24 13:22:29.721634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 675/1341] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:29 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:30.737916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bff745ba-e9f5-4b15-84e9-43ec32ecf722 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:30.738562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bff745ba-e9f5-4b15-84e9-43ec32ecf722 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:30.744959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bff745ba-e9f5-4b15-84e9-43ec32ecf722 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:30.745408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bff745ba-e9f5-4b15-84e9-43ec32ecf722 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:30.746167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bff745ba-e9f5-4b15-84e9-43ec32ecf722 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:30.746626 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bff745ba-e9f5-4b15-84e9-43ec32ecf722 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:30.808939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bff745ba-e9f5-4b15-84e9-43ec32ecf722 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:30.816858 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bff745ba-e9f5-4b15-84e9-43ec32ecf722 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083037 May 24 13:22:30.817418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 667/1342] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:30 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:31.833535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e7eef849-e8de-42e9-ab64-02bfc011843b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:31.834165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e7eef849-e8de-42e9-ab64-02bfc011843b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:31.841341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e7eef849-e8de-42e9-ab64-02bfc011843b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:31.841785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e7eef849-e8de-42e9-ab64-02bfc011843b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:31.842571 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e7eef849-e8de-42e9-ab64-02bfc011843b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:31.843005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e7eef849-e8de-42e9-ab64-02bfc011843b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:31.907551 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e7eef849-e8de-42e9-ab64-02bfc011843b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:31.915142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e7eef849-e8de-42e9-ab64-02bfc011843b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085503 May 24 13:22:31.915705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 676/1343] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:31 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:32.932060 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e041c6c8-9c35-458a-a319-5233d499c036 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:32.932678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e041c6c8-9c35-458a-a319-5233d499c036 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:32.934990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=42 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:22:32.940717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e041c6c8-9c35-458a-a319-5233d499c036 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:32.941164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e041c6c8-9c35-458a-a319-5233d499c036 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:32.941921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e041c6c8-9c35-458a-a319-5233d499c036 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:32.942387 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e041c6c8-9c35-458a-a319-5233d499c036 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:33.002865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e041c6c8-9c35-458a-a319-5233d499c036 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:33.010215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e041c6c8-9c35-458a-a319-5233d499c036 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082098 May 24 13:22:33.010796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 668/1344] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:32 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:34.026969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7c6adf27-ad8b-4db1-9f52-caf6091d157e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:34.027583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7c6adf27-ad8b-4db1-9f52-caf6091d157e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:34.034076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c6adf27-ad8b-4db1-9f52-caf6091d157e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:34.034561 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c6adf27-ad8b-4db1-9f52-caf6091d157e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:34.035311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c6adf27-ad8b-4db1-9f52-caf6091d157e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:34.035744 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c6adf27-ad8b-4db1-9f52-caf6091d157e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:34.095510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7c6adf27-ad8b-4db1-9f52-caf6091d157e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:34.103055 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7c6adf27-ad8b-4db1-9f52-caf6091d157e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079911 May 24 13:22:34.103615 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 677/1345] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:34 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:35.120639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fad0b73f-fd06-434f-8c6d-0aee4ee6d266 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:35.121374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fad0b73f-fd06-434f-8c6d-0aee4ee6d266 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:35.127885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fad0b73f-fd06-434f-8c6d-0aee4ee6d266 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:35.128340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fad0b73f-fd06-434f-8c6d-0aee4ee6d266 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:35.129096 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fad0b73f-fd06-434f-8c6d-0aee4ee6d266 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:35.129560 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fad0b73f-fd06-434f-8c6d-0aee4ee6d266 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:35.188657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fad0b73f-fd06-434f-8c6d-0aee4ee6d266 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:35.196158 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fad0b73f-fd06-434f-8c6d-0aee4ee6d266 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079453 May 24 13:22:35.196721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 669/1346] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:35 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:36.213450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-99aa5021-04a5-4c90-8151-a17d160f95f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:36.214063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-99aa5021-04a5-4c90-8151-a17d160f95f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:36.221038 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-99aa5021-04a5-4c90-8151-a17d160f95f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:36.221480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-99aa5021-04a5-4c90-8151-a17d160f95f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:36.222230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-99aa5021-04a5-4c90-8151-a17d160f95f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:36.222698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-99aa5021-04a5-4c90-8151-a17d160f95f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:36.287715 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-99aa5021-04a5-4c90-8151-a17d160f95f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:36.295972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-99aa5021-04a5-4c90-8151-a17d160f95f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.086444 May 24 13:22:36.296534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 678/1347] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:36 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:37.312889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9ddfaa00-08f3-43bf-900b-774a9572d724 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:37.313484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9ddfaa00-08f3-43bf-900b-774a9572d724 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:37.320042 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ddfaa00-08f3-43bf-900b-774a9572d724 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:37.320482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ddfaa00-08f3-43bf-900b-774a9572d724 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:37.321232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ddfaa00-08f3-43bf-900b-774a9572d724 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:37.321662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ddfaa00-08f3-43bf-900b-774a9572d724 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:37.380865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9ddfaa00-08f3-43bf-900b-774a9572d724 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:37.388329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9ddfaa00-08f3-43bf-900b-774a9572d724 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079309 May 24 13:22:37.388919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 670/1348] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:37 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:38.405727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-11d402c0-fe39-4aed-879b-12572b8364a5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:38.406405 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-11d402c0-fe39-4aed-879b-12572b8364a5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:38.413258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11d402c0-fe39-4aed-879b-12572b8364a5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:38.413697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11d402c0-fe39-4aed-879b-12572b8364a5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:38.414478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11d402c0-fe39-4aed-879b-12572b8364a5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:38.414908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11d402c0-fe39-4aed-879b-12572b8364a5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:38.476565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-11d402c0-fe39-4aed-879b-12572b8364a5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:38.484193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-11d402c0-fe39-4aed-879b-12572b8364a5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082278 May 24 13:22:38.485084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 679/1349] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:38 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:39.502196 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0c2a3943-10eb-4118-b608-0c24a3af0ff9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:39.502863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0c2a3943-10eb-4118-b608-0c24a3af0ff9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:39.509322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2a3943-10eb-4118-b608-0c24a3af0ff9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:39.509772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2a3943-10eb-4118-b608-0c24a3af0ff9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:39.510559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2a3943-10eb-4118-b608-0c24a3af0ff9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:39.510997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2a3943-10eb-4118-b608-0c24a3af0ff9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:39.575663 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0c2a3943-10eb-4118-b608-0c24a3af0ff9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:39.583415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0c2a3943-10eb-4118-b608-0c24a3af0ff9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085802 May 24 13:22:39.584033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 671/1350] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:39 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:40.600522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b9e12952-19fb-4a7b-ba8d-c5112b403c87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:40.601136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b9e12952-19fb-4a7b-ba8d-c5112b403c87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:40.607608 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b9e12952-19fb-4a7b-ba8d-c5112b403c87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:40.608075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b9e12952-19fb-4a7b-ba8d-c5112b403c87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:40.608836 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b9e12952-19fb-4a7b-ba8d-c5112b403c87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:40.609273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b9e12952-19fb-4a7b-ba8d-c5112b403c87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:40.668865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b9e12952-19fb-4a7b-ba8d-c5112b403c87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:40.677440 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b9e12952-19fb-4a7b-ba8d-c5112b403c87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081233 May 24 13:22:40.678006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 680/1351] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:40 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:41.694445 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aebf12f0-ca9c-42ab-86a6-6e5a8fddf30d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:41.694998 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aebf12f0-ca9c-42ab-86a6-6e5a8fddf30d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:41.701310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aebf12f0-ca9c-42ab-86a6-6e5a8fddf30d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:41.701756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aebf12f0-ca9c-42ab-86a6-6e5a8fddf30d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:41.702524 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aebf12f0-ca9c-42ab-86a6-6e5a8fddf30d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:41.702956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aebf12f0-ca9c-42ab-86a6-6e5a8fddf30d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:41.761461 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-aebf12f0-ca9c-42ab-86a6-6e5a8fddf30d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:41.769334 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aebf12f0-ca9c-42ab-86a6-6e5a8fddf30d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.078947 May 24 13:22:41.769889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 672/1352] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:41 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:42.787012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ec4fc261-0934-4952-bc7e-740921041e2b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:42.787630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ec4fc261-0934-4952-bc7e-740921041e2b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:42.794092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec4fc261-0934-4952-bc7e-740921041e2b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:42.794574 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec4fc261-0934-4952-bc7e-740921041e2b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:42.795341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec4fc261-0934-4952-bc7e-740921041e2b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:42.795775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec4fc261-0934-4952-bc7e-740921041e2b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:42.855776 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ec4fc261-0934-4952-bc7e-740921041e2b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:42.864171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ec4fc261-0934-4952-bc7e-740921041e2b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081508 May 24 13:22:42.864745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 681/1353] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:42 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:43.882071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a8c2a8b-f2c2-44a1-94b1-83eaacda5000 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:43.882707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a8c2a8b-f2c2-44a1-94b1-83eaacda5000 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:43.889155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a8c2a8b-f2c2-44a1-94b1-83eaacda5000 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:43.889600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a8c2a8b-f2c2-44a1-94b1-83eaacda5000 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:43.891004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a8c2a8b-f2c2-44a1-94b1-83eaacda5000 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:43.891588 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a8c2a8b-f2c2-44a1-94b1-83eaacda5000 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:43.952934 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a8c2a8b-f2c2-44a1-94b1-83eaacda5000 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:43.960485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a8c2a8b-f2c2-44a1-94b1-83eaacda5000 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082819 May 24 13:22:43.961039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 673/1354] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:43 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:44.977679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8dfe7792-1d42-44b1-a95a-8a91e9df74ff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:44.978319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8dfe7792-1d42-44b1-a95a-8a91e9df74ff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:44.984796 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dfe7792-1d42-44b1-a95a-8a91e9df74ff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:44.985531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dfe7792-1d42-44b1-a95a-8a91e9df74ff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:44.986310 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dfe7792-1d42-44b1-a95a-8a91e9df74ff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:44.986742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8dfe7792-1d42-44b1-a95a-8a91e9df74ff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:45.051346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8dfe7792-1d42-44b1-a95a-8a91e9df74ff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:45.064106 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8dfe7792-1d42-44b1-a95a-8a91e9df74ff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.090271 May 24 13:22:45.064674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 682/1355] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:44 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:46.081539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5c4f6542-0c67-4e70-821b-aac9f5197977 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:46.082143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5c4f6542-0c67-4e70-821b-aac9f5197977 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:46.088678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c4f6542-0c67-4e70-821b-aac9f5197977 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:46.089123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c4f6542-0c67-4e70-821b-aac9f5197977 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:46.089871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c4f6542-0c67-4e70-821b-aac9f5197977 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:46.090316 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c4f6542-0c67-4e70-821b-aac9f5197977 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:46.154629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5c4f6542-0c67-4e70-821b-aac9f5197977 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:46.161935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5c4f6542-0c67-4e70-821b-aac9f5197977 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084951 May 24 13:22:46.162523 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 674/1356] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:46 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:47.177931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-593220b1-e760-43d9-946a-a20c7eaa46c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:47.178560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-593220b1-e760-43d9-946a-a20c7eaa46c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:47.184982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-593220b1-e760-43d9-946a-a20c7eaa46c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:47.185425 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-593220b1-e760-43d9-946a-a20c7eaa46c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:47.186208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-593220b1-e760-43d9-946a-a20c7eaa46c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:47.186669 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-593220b1-e760-43d9-946a-a20c7eaa46c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:47.246105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-593220b1-e760-43d9-946a-a20c7eaa46c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:47.253971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-593220b1-e760-43d9-946a-a20c7eaa46c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079937 May 24 13:22:47.254569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 683/1357] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:47 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:48.270759 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4b5f7095-95be-4d67-aef2-9f9dfc300002 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:48.271374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4b5f7095-95be-4d67-aef2-9f9dfc300002 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:48.277575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4b5f7095-95be-4d67-aef2-9f9dfc300002 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:48.278044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4b5f7095-95be-4d67-aef2-9f9dfc300002 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:48.278823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4b5f7095-95be-4d67-aef2-9f9dfc300002 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:48.279254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4b5f7095-95be-4d67-aef2-9f9dfc300002 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:48.341463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4b5f7095-95be-4d67-aef2-9f9dfc300002 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:48.349757 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4b5f7095-95be-4d67-aef2-9f9dfc300002 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082999 May 24 13:22:48.350338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 675/1358] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:48 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:49.366728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-86869760-5e11-42b6-9596-d9686c1966cd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:49.367340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-86869760-5e11-42b6-9596-d9686c1966cd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:49.373793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86869760-5e11-42b6-9596-d9686c1966cd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:49.374243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86869760-5e11-42b6-9596-d9686c1966cd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:49.375029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86869760-5e11-42b6-9596-d9686c1966cd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:49.375461 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86869760-5e11-42b6-9596-d9686c1966cd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:49.436492 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-86869760-5e11-42b6-9596-d9686c1966cd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:49.444362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-86869760-5e11-42b6-9596-d9686c1966cd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081477 May 24 13:22:49.444917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 684/1359] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:49 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:50.460785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5d5a466a-5286-439e-bf9b-69ed64589675 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:50.461399 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5d5a466a-5286-439e-bf9b-69ed64589675 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:50.468039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d5a466a-5286-439e-bf9b-69ed64589675 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:50.468429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d5a466a-5286-439e-bf9b-69ed64589675 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:50.469184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d5a466a-5286-439e-bf9b-69ed64589675 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:50.469614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d5a466a-5286-439e-bf9b-69ed64589675 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:50.529542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5d5a466a-5286-439e-bf9b-69ed64589675 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:50.537534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5d5a466a-5286-439e-bf9b-69ed64589675 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080604 May 24 13:22:50.538097 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 676/1360] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:50 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:51.554999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a6c5e992-2daa-46a3-81a9-645bdeacc163 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:51.556531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a6c5e992-2daa-46a3-81a9-645bdeacc163 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:51.563250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6c5e992-2daa-46a3-81a9-645bdeacc163 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:51.563697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6c5e992-2daa-46a3-81a9-645bdeacc163 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:51.564454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6c5e992-2daa-46a3-81a9-645bdeacc163 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:51.564884 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6c5e992-2daa-46a3-81a9-645bdeacc163 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:51.628127 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a6c5e992-2daa-46a3-81a9-645bdeacc163 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:51.639264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a6c5e992-2daa-46a3-81a9-645bdeacc163 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.088082 May 24 13:22:51.639832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 685/1361] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:51 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:52.656200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-830ded88-8196-4d3a-8157-3ec42477c8c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:52.656816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-830ded88-8196-4d3a-8157-3ec42477c8c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:52.663254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-830ded88-8196-4d3a-8157-3ec42477c8c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:52.663700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-830ded88-8196-4d3a-8157-3ec42477c8c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:52.664457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-830ded88-8196-4d3a-8157-3ec42477c8c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:52.664890 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-830ded88-8196-4d3a-8157-3ec42477c8c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:52.724305 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-830ded88-8196-4d3a-8157-3ec42477c8c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:52.731715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-830ded88-8196-4d3a-8157-3ec42477c8c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079419 May 24 13:22:52.732281 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 677/1362] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:52 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:53.748672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-26fd7d64-5db6-4793-b480-05f6c02b4fec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:53.749292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-26fd7d64-5db6-4793-b480-05f6c02b4fec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:53.755793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-26fd7d64-5db6-4793-b480-05f6c02b4fec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:53.756245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-26fd7d64-5db6-4793-b480-05f6c02b4fec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:53.757002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-26fd7d64-5db6-4793-b480-05f6c02b4fec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:53.757438 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-26fd7d64-5db6-4793-b480-05f6c02b4fec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:53.761306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=80 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:22:53.821207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-26fd7d64-5db6-4793-b480-05f6c02b4fec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:53.828703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-26fd7d64-5db6-4793-b480-05f6c02b4fec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083910 May 24 13:22:53.829252 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 686/1363] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:53 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:54.846565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4620518b-d201-4814-9f01-dee10d914512 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:54.847194 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4620518b-d201-4814-9f01-dee10d914512 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:54.853775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4620518b-d201-4814-9f01-dee10d914512 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:54.854228 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4620518b-d201-4814-9f01-dee10d914512 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:54.855029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4620518b-d201-4814-9f01-dee10d914512 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:54.855468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4620518b-d201-4814-9f01-dee10d914512 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:54.917525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4620518b-d201-4814-9f01-dee10d914512 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:54.925634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4620518b-d201-4814-9f01-dee10d914512 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083529 May 24 13:22:54.926195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 678/1364] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:54 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:55.942523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5648fa91-12fa-4f0b-ac8d-2e522564c696 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:55.943053 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5648fa91-12fa-4f0b-ac8d-2e522564c696 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:55.949643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5648fa91-12fa-4f0b-ac8d-2e522564c696 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:55.950086 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5648fa91-12fa-4f0b-ac8d-2e522564c696 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:55.950937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5648fa91-12fa-4f0b-ac8d-2e522564c696 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:55.951372 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5648fa91-12fa-4f0b-ac8d-2e522564c696 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:56.013040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5648fa91-12fa-4f0b-ac8d-2e522564c696 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:56.023324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5648fa91-12fa-4f0b-ac8d-2e522564c696 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085300 May 24 13:22:56.023903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 687/1365] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:55 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:57.040255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-26031478-96eb-4b08-8789-60cbaaa28069 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:57.040871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-26031478-96eb-4b08-8789-60cbaaa28069 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:57.047346 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26031478-96eb-4b08-8789-60cbaaa28069 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:57.047795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26031478-96eb-4b08-8789-60cbaaa28069 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:57.048554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26031478-96eb-4b08-8789-60cbaaa28069 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:57.048987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26031478-96eb-4b08-8789-60cbaaa28069 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:57.051533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=86 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:22:57.112394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-26031478-96eb-4b08-8789-60cbaaa28069 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:57.119855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-26031478-96eb-4b08-8789-60cbaaa28069 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083444 May 24 13:22:57.120426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 679/1366] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:57 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:22:58.136941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0e13cd79-df70-4989-ada0-1ef6db15e232 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:58.137533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0e13cd79-df70-4989-ada0-1ef6db15e232 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:58.144672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0e13cd79-df70-4989-ada0-1ef6db15e232 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:58.145114 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0e13cd79-df70-4989-ada0-1ef6db15e232 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:58.145866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0e13cd79-df70-4989-ada0-1ef6db15e232 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:58.146317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0e13cd79-df70-4989-ada0-1ef6db15e232 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:58.207276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0e13cd79-df70-4989-ada0-1ef6db15e232 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:58.214652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0e13cd79-df70-4989-ada0-1ef6db15e232 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081580 May 24 13:22:58.215213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 688/1367] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:58 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:22:59.232011 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fdfb6048-61b6-41d3-97e7-bd08605d902e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:22:59.232650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fdfb6048-61b6-41d3-97e7-bd08605d902e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:22:59.239516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdfb6048-61b6-41d3-97e7-bd08605d902e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:59.239961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdfb6048-61b6-41d3-97e7-bd08605d902e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:59.240703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdfb6048-61b6-41d3-97e7-bd08605d902e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:22:59.241130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdfb6048-61b6-41d3-97e7-bd08605d902e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:22:59.301113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fdfb6048-61b6-41d3-97e7-bd08605d902e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:22:59.308489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fdfb6048-61b6-41d3-97e7-bd08605d902e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080351 May 24 13:22:59.309049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 680/1368] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:22:59 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:00.325715 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5d834b48-420a-4464-817b-6d779780a521 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:00.326391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5d834b48-420a-4464-817b-6d779780a521 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:00.328705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=28 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:00.334626 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d834b48-420a-4464-817b-6d779780a521 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:00.335075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d834b48-420a-4464-817b-6d779780a521 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:00.335838 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d834b48-420a-4464-817b-6d779780a521 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:00.336277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d834b48-420a-4464-817b-6d779780a521 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:00.396998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5d834b48-420a-4464-817b-6d779780a521 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:00.404653 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5d834b48-420a-4464-817b-6d779780a521 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082782 May 24 13:23:00.405211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 689/1369] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:00 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:01.422651 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f6970d7b-6134-47a1-b44e-868f5c2ff289 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:01.423271 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f6970d7b-6134-47a1-b44e-868f5c2ff289 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:01.429700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6970d7b-6134-47a1-b44e-868f5c2ff289 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:01.430145 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6970d7b-6134-47a1-b44e-868f5c2ff289 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:01.430940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6970d7b-6134-47a1-b44e-868f5c2ff289 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:01.431374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6970d7b-6134-47a1-b44e-868f5c2ff289 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:01.490807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f6970d7b-6134-47a1-b44e-868f5c2ff289 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:01.498197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f6970d7b-6134-47a1-b44e-868f5c2ff289 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079394 May 24 13:23:01.498791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 681/1370] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:01 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:02.515305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6f9127e6-ab33-4227-a252-1b6b967b611e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:02.515855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6f9127e6-ab33-4227-a252-1b6b967b611e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:02.522415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f9127e6-ab33-4227-a252-1b6b967b611e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:02.522865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f9127e6-ab33-4227-a252-1b6b967b611e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:02.523628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f9127e6-ab33-4227-a252-1b6b967b611e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:02.524063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f9127e6-ab33-4227-a252-1b6b967b611e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:02.587432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6f9127e6-ab33-4227-a252-1b6b967b611e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:02.594994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6f9127e6-ab33-4227-a252-1b6b967b611e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083658 May 24 13:23:02.595547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 690/1371] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:02 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:03.612118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-17f4120b-884f-496b-ba45-d9ef6ddb720b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:03.612734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-17f4120b-884f-496b-ba45-d9ef6ddb720b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:03.615058 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=28 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:03.620483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17f4120b-884f-496b-ba45-d9ef6ddb720b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:03.620927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17f4120b-884f-496b-ba45-d9ef6ddb720b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:03.621688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17f4120b-884f-496b-ba45-d9ef6ddb720b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:03.622118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17f4120b-884f-496b-ba45-d9ef6ddb720b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:03.681554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-17f4120b-884f-496b-ba45-d9ef6ddb720b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:03.689049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-17f4120b-884f-496b-ba45-d9ef6ddb720b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081136 May 24 13:23:03.690140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 682/1372] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:03 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:04.706420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0de974ec-c8b5-4489-85c1-3725072beafd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:04.707048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0de974ec-c8b5-4489-85c1-3725072beafd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:04.713558 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0de974ec-c8b5-4489-85c1-3725072beafd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:04.714007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0de974ec-c8b5-4489-85c1-3725072beafd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:04.714939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0de974ec-c8b5-4489-85c1-3725072beafd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:04.715380 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0de974ec-c8b5-4489-85c1-3725072beafd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:04.775215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0de974ec-c8b5-4489-85c1-3725072beafd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:04.782662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0de974ec-c8b5-4489-85c1-3725072beafd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080092 May 24 13:23:04.783725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 691/1373] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:04 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:05.799939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-69f794f3-12ca-4233-8da0-a83e8f3fd903 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:05.800513 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-69f794f3-12ca-4233-8da0-a83e8f3fd903 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:05.807022 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69f794f3-12ca-4233-8da0-a83e8f3fd903 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:05.807472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69f794f3-12ca-4233-8da0-a83e8f3fd903 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:05.808229 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69f794f3-12ca-4233-8da0-a83e8f3fd903 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:05.808658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69f794f3-12ca-4233-8da0-a83e8f3fd903 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:05.877808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-69f794f3-12ca-4233-8da0-a83e8f3fd903 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:05.885376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-69f794f3-12ca-4233-8da0-a83e8f3fd903 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.089359 May 24 13:23:05.885942 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 683/1374] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:05 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:06.902832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a7ddd3b4-b308-4470-a4f3-044980cd3928 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:06.903441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a7ddd3b4-b308-4470-a4f3-044980cd3928 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:06.910629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd3b4-b308-4470-a4f3-044980cd3928 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:06.911107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd3b4-b308-4470-a4f3-044980cd3928 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:06.911868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd3b4-b308-4470-a4f3-044980cd3928 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:06.912300 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd3b4-b308-4470-a4f3-044980cd3928 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:06.976328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a7ddd3b4-b308-4470-a4f3-044980cd3928 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:06.984100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a7ddd3b4-b308-4470-a4f3-044980cd3928 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085154 May 24 13:23:06.984660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 692/1375] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:06 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:08.001734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e3437cb6-b2d7-4ed1-8909-c17ebc949a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:08.003003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e3437cb6-b2d7-4ed1-8909-c17ebc949a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:08.009692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3437cb6-b2d7-4ed1-8909-c17ebc949a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:08.010166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3437cb6-b2d7-4ed1-8909-c17ebc949a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:08.010954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3437cb6-b2d7-4ed1-8909-c17ebc949a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:08.011412 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3437cb6-b2d7-4ed1-8909-c17ebc949a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:08.071564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e3437cb6-b2d7-4ed1-8909-c17ebc949a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:08.079014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e3437cb6-b2d7-4ed1-8909-c17ebc949a57 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081154 May 24 13:23:08.079832 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 684/1376] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:07 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:09.096459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-63a86a46-9eee-400e-8d82-fa5af195ec79 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:09.097099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-63a86a46-9eee-400e-8d82-fa5af195ec79 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:09.103774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63a86a46-9eee-400e-8d82-fa5af195ec79 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:09.104230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63a86a46-9eee-400e-8d82-fa5af195ec79 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:09.104990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63a86a46-9eee-400e-8d82-fa5af195ec79 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:09.105430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63a86a46-9eee-400e-8d82-fa5af195ec79 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:09.165543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-63a86a46-9eee-400e-8d82-fa5af195ec79 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:09.172976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-63a86a46-9eee-400e-8d82-fa5af195ec79 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081009 May 24 13:23:09.173536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 693/1377] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:09 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:10.189894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d58ecd1e-b0b3-432f-a66b-e81c854b9125 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:10.190542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d58ecd1e-b0b3-432f-a66b-e81c854b9125 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:10.197212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d58ecd1e-b0b3-432f-a66b-e81c854b9125 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:10.197664 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d58ecd1e-b0b3-432f-a66b-e81c854b9125 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:10.198462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d58ecd1e-b0b3-432f-a66b-e81c854b9125 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:10.198901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d58ecd1e-b0b3-432f-a66b-e81c854b9125 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:10.260801 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d58ecd1e-b0b3-432f-a66b-e81c854b9125 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:10.268856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d58ecd1e-b0b3-432f-a66b-e81c854b9125 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082837 May 24 13:23:10.269427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 685/1378] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:10 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:11.286203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0dcede01-6885-4ef9-813c-77280fb672d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:11.286849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0dcede01-6885-4ef9-813c-77280fb672d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:11.293374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dcede01-6885-4ef9-813c-77280fb672d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:11.293830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dcede01-6885-4ef9-813c-77280fb672d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:11.294629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dcede01-6885-4ef9-813c-77280fb672d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:11.295070 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0dcede01-6885-4ef9-813c-77280fb672d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:11.357485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0dcede01-6885-4ef9-813c-77280fb672d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:11.365869 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0dcede01-6885-4ef9-813c-77280fb672d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084152 May 24 13:23:11.366476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 694/1379] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:11 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:12.382973 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ebb6af7f-ad6a-4ee3-b4f4-ed1f337376e4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:12.383595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ebb6af7f-ad6a-4ee3-b4f4-ed1f337376e4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:12.390063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebb6af7f-ad6a-4ee3-b4f4-ed1f337376e4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:12.390545 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebb6af7f-ad6a-4ee3-b4f4-ed1f337376e4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:12.391309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebb6af7f-ad6a-4ee3-b4f4-ed1f337376e4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:12.391768 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebb6af7f-ad6a-4ee3-b4f4-ed1f337376e4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:12.451804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ebb6af7f-ad6a-4ee3-b4f4-ed1f337376e4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:12.460088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ebb6af7f-ad6a-4ee3-b4f4-ed1f337376e4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081019 May 24 13:23:12.460660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 686/1380] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:12 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:13.476793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a2203302-e77c-416f-9180-e1909f663d09 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:13.477406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a2203302-e77c-416f-9180-e1909f663d09 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:13.483883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2203302-e77c-416f-9180-e1909f663d09 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:13.484330 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2203302-e77c-416f-9180-e1909f663d09 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:13.485342 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2203302-e77c-416f-9180-e1909f663d09 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:13.485772 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a2203302-e77c-416f-9180-e1909f663d09 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:13.547042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a2203302-e77c-416f-9180-e1909f663d09 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:13.554442 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a2203302-e77c-416f-9180-e1909f663d09 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081460 May 24 13:23:13.555002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 695/1381] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:13 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:14.570948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-51ab16a0-dd95-418e-95ca-042373936f7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:14.571567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-51ab16a0-dd95-418e-95ca-042373936f7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:14.578047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51ab16a0-dd95-418e-95ca-042373936f7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:14.578545 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51ab16a0-dd95-418e-95ca-042373936f7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:14.579311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51ab16a0-dd95-418e-95ca-042373936f7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:14.580306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51ab16a0-dd95-418e-95ca-042373936f7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:14.642163 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-51ab16a0-dd95-418e-95ca-042373936f7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:14.650117 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-51ab16a0-dd95-418e-95ca-042373936f7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083072 May 24 13:23:14.650721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 687/1382] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:14 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:15.667835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e59f033f-adc4-41cf-a43c-97e3abf44648 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:15.668388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e59f033f-adc4-41cf-a43c-97e3abf44648 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:15.674903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e59f033f-adc4-41cf-a43c-97e3abf44648 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:15.675343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e59f033f-adc4-41cf-a43c-97e3abf44648 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:15.676096 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e59f033f-adc4-41cf-a43c-97e3abf44648 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:15.676528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e59f033f-adc4-41cf-a43c-97e3abf44648 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:15.736899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e59f033f-adc4-41cf-a43c-97e3abf44648 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:15.744288 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e59f033f-adc4-41cf-a43c-97e3abf44648 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080359 May 24 13:23:15.744828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 696/1383] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:15 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:16.761154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b704e6c6-8f10-46e4-8c38-2b61722b7860 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:16.761753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b704e6c6-8f10-46e4-8c38-2b61722b7860 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:16.768235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b704e6c6-8f10-46e4-8c38-2b61722b7860 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:16.768680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b704e6c6-8f10-46e4-8c38-2b61722b7860 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:16.769430 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b704e6c6-8f10-46e4-8c38-2b61722b7860 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:16.769856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b704e6c6-8f10-46e4-8c38-2b61722b7860 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:16.831262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b704e6c6-8f10-46e4-8c38-2b61722b7860 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:16.838745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b704e6c6-8f10-46e4-8c38-2b61722b7860 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081366 May 24 13:23:16.839304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 688/1384] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:16 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:17.855349 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ecee457b-5bce-40f2-9d1b-d54cc4d44acb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:17.855967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ecee457b-5bce-40f2-9d1b-d54cc4d44acb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:17.862527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ecee457b-5bce-40f2-9d1b-d54cc4d44acb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:17.862975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ecee457b-5bce-40f2-9d1b-d54cc4d44acb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:17.863727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ecee457b-5bce-40f2-9d1b-d54cc4d44acb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:17.864186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ecee457b-5bce-40f2-9d1b-d54cc4d44acb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:17.923388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ecee457b-5bce-40f2-9d1b-d54cc4d44acb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:17.930828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ecee457b-5bce-40f2-9d1b-d54cc4d44acb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079330 May 24 13:23:17.931386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 697/1385] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:17 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:18.948486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7d47bae5-f2bd-4a91-bf4c-7d92d9b21c7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:18.949083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7d47bae5-f2bd-4a91-bf4c-7d92d9b21c7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:18.955151 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d47bae5-f2bd-4a91-bf4c-7d92d9b21c7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:18.955596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d47bae5-f2bd-4a91-bf4c-7d92d9b21c7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:18.956351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d47bae5-f2bd-4a91-bf4c-7d92d9b21c7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:18.956785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d47bae5-f2bd-4a91-bf4c-7d92d9b21c7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:19.015961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7d47bae5-f2bd-4a91-bf4c-7d92d9b21c7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:19.023340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7d47bae5-f2bd-4a91-bf4c-7d92d9b21c7d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.078888 May 24 13:23:19.023900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 689/1386] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:18 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:20.041137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a16d6c4e-1926-4061-b230-875ad95874eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:20.041759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a16d6c4e-1926-4061-b230-875ad95874eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:20.048392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a16d6c4e-1926-4061-b230-875ad95874eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:20.048846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a16d6c4e-1926-4061-b230-875ad95874eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:20.049609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a16d6c4e-1926-4061-b230-875ad95874eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:20.050050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a16d6c4e-1926-4061-b230-875ad95874eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:20.113572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a16d6c4e-1926-4061-b230-875ad95874eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:20.121195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a16d6c4e-1926-4061-b230-875ad95874eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083914 May 24 13:23:20.121760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 698/1387] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:20 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:20.690734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:23:20.691308 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:23:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:23:21.137957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-67e32caf-5d5d-400c-b439-2040bc977a53 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:21.138596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-67e32caf-5d5d-400c-b439-2040bc977a53 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:21.145759 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67e32caf-5d5d-400c-b439-2040bc977a53 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:21.146200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67e32caf-5d5d-400c-b439-2040bc977a53 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:21.146972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67e32caf-5d5d-400c-b439-2040bc977a53 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:21.147400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67e32caf-5d5d-400c-b439-2040bc977a53 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:21.206725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67e32caf-5d5d-400c-b439-2040bc977a53 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:21.214083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-67e32caf-5d5d-400c-b439-2040bc977a53 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079999 May 24 13:23:21.214703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 690/1388] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:21 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:22.230488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d4e039e6-46bd-49bc-b9dc-d1c470bd24fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:22.231116 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d4e039e6-46bd-49bc-b9dc-d1c470bd24fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:22.237644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4e039e6-46bd-49bc-b9dc-d1c470bd24fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:22.238101 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4e039e6-46bd-49bc-b9dc-d1c470bd24fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:22.238898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4e039e6-46bd-49bc-b9dc-d1c470bd24fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:22.239343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4e039e6-46bd-49bc-b9dc-d1c470bd24fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:22.311180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d4e039e6-46bd-49bc-b9dc-d1c470bd24fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:22.318945 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d4e039e6-46bd-49bc-b9dc-d1c470bd24fe tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.092369 May 24 13:23:22.319510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 699/1389] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:22 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:23.335842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b0ede0c2-ca7b-4cd5-8727-595fc160ca19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:23.336460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b0ede0c2-ca7b-4cd5-8727-595fc160ca19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:23.342965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0ede0c2-ca7b-4cd5-8727-595fc160ca19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:23.343411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0ede0c2-ca7b-4cd5-8727-595fc160ca19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:23.344222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0ede0c2-ca7b-4cd5-8727-595fc160ca19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:23.344633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0ede0c2-ca7b-4cd5-8727-595fc160ca19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:23.407480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b0ede0c2-ca7b-4cd5-8727-595fc160ca19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:23.415533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b0ede0c2-ca7b-4cd5-8727-595fc160ca19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083626 May 24 13:23:23.416099 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 691/1390] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:23 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:23.866801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c353c5a9-cb19-4093-9217-872624921a46 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:23.867811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c353c5a9-cb19-4093-9217-872624921a46 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:23.875378 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c353c5a9-cb19-4093-9217-872624921a46 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:23.875830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c353c5a9-cb19-4093-9217-872624921a46 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:23.876600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c353c5a9-cb19-4093-9217-872624921a46 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:23.877033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c353c5a9-cb19-4093-9217-872624921a46 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:23.892822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=84 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:23.903240 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c353c5a9-cb19-4093-9217-872624921a46 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Going to try to terminate instance {{(pid=117643) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:23:23.907573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:23.909259 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:23.915856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:23.916766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:23.917440 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:23.918047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:23.934434 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] HTTP exception thrown: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Request method failure captured: May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 HTTP/1.1 May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNbZoQy-eR6FHCFODsrK1xBISdBLWpwyMp6dg7yRQRwGroYtc1-dSGvt5AdTvnp7FEoW1Xyxx5-Kmg0aHlgoIWJlk6ZbcODSL2sqXnQ3_jkyBEaHJuGuLt1dIeCk1FofyWKyjZaTfkIP8sZB7SHcX8royL2ZXZTfs_libM9gJbh_Izg May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Openstack-Nova-Api-Version: 2.20 May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: e57720cd453848a89315ad87ace38161 May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:23:23.936487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e57720cd453848a89315ad87ace38161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e57720cd453848a89315ad87ace38161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: e57720cd453848a89315ad87ace38161 May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: f7b0dfb3d6514817aba4ab34fd972ba1 May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.938309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '8dbd25ed-5661-4c08-949c-27204c6c1172'} May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:23:23.939883 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.941335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.943248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Returning 404 to user: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:23:23.943248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dbad35a8-47a1-427d-ab3e-6a484599025d tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 404 len: 111 microversion: 2.20 time: 0.034873 May 24 13:23:23.943248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 692/1391] 10.222.0.45 () {60 vars in 1279 bytes} [Tue May 24 13:23:23 2022] DELETE /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 13:23:23.947487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:23.948081 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] [instance: 8dbd25ed-5661-4c08-949c-27204c6c1172] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:23.953979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:23.954525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:23.955803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:23.956237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:23.970075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] HTTP exception thrown: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Request method failure captured: May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 HTTP/1.1 May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNbZoQy-eR6FHCFODsrK1xBISdBLWpwyMp6dg7yRQRwGroYtc1-dSGvt5AdTvnp7FEoW1Xyxx5-Kmg0aHlgoIWJlk6ZbcODSL2sqXnQ3_jkyBEaHJuGuLt1dIeCk1FofyWKyjZaTfkIP8sZB7SHcX8royL2ZXZTfs_libM9gJbh_Izg May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Openstack-Nova-Api-Version: 2.20 May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: e57720cd453848a89315ad87ace38161 May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:23:23.971623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e57720cd453848a89315ad87ace38161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e57720cd453848a89315ad87ace38161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e57720cd453848a89315ad87ace38161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: e57720cd453848a89315ad87ace38161 May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-372103274 May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: f7b0dfb3d6514817aba4ab34fd972ba1 May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-372103274-project May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.973953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '8dbd25ed-5661-4c08-949c-27204c6c1172'} May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:23:23.975313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. May 24 13:23:23.976956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:23:23.978481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] Returning 404 to user: Instance 8dbd25ed-5661-4c08-949c-27204c6c1172 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:23:23.978481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ef24fed9-8e2a-4f98-8f18-22b31ac0ccbc tempest-AttachVolumeShelveTestJSON-372103274 tempest-AttachVolumeShelveTestJSON-372103274-project] 10.222.0.45 "GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172" status: 404 len: 111 microversion: 2.20 time: 0.029813 May 24 13:23:23.981322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 693/1392] 10.222.0.45 () {60 vars in 1276 bytes} [Tue May 24 13:23:23 2022] GET /compute/v2.1/servers/8dbd25ed-5661-4c08-949c-27204c6c1172 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 24 13:23:23.986312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c353c5a9-cb19-4093-9217-872624921a46 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "DELETE /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 204 len: 0 microversion: 2.1 time: 0.121813 May 24 13:23:23.989536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 700/1393] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:23:23 2022] DELETE /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:23:23.996920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7a5018cf-c5ab-4af4-9e59-b8375ca16086 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:23.997538 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7a5018cf-c5ab-4af4-9e59-b8375ca16086 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:24.004352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a5018cf-c5ab-4af4-9e59-b8375ca16086 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:24.004802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a5018cf-c5ab-4af4-9e59-b8375ca16086 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:24.005575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a5018cf-c5ab-4af4-9e59-b8375ca16086 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:24.005997 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a5018cf-c5ab-4af4-9e59-b8375ca16086 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:24.135413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7a5018cf-c5ab-4af4-9e59-b8375ca16086 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:24.143857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7a5018cf-c5ab-4af4-9e59-b8375ca16086 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1555 microversion: 2.1 time: 0.150669 May 24 13:23:24.144878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 694/1394] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:23 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:24.433757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6c902d51-ea5b-4c48-8736-eb7c9ec0b2c8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:24.435362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6c902d51-ea5b-4c48-8736-eb7c9ec0b2c8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:24.441986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c902d51-ea5b-4c48-8736-eb7c9ec0b2c8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:24.442543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c902d51-ea5b-4c48-8736-eb7c9ec0b2c8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:24.443539 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c902d51-ea5b-4c48-8736-eb7c9ec0b2c8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:24.443991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c902d51-ea5b-4c48-8736-eb7c9ec0b2c8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:24.516454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6c902d51-ea5b-4c48-8736-eb7c9ec0b2c8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:24.524426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6c902d51-ea5b-4c48-8736-eb7c9ec0b2c8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.094930 May 24 13:23:24.525018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 701/1395] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:24 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:25.160894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-be2c0feb-6587-406e-a4ff-95a2b2dcc455 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:25.162255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-be2c0feb-6587-406e-a4ff-95a2b2dcc455 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:25.169002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be2c0feb-6587-406e-a4ff-95a2b2dcc455 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:25.169823 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be2c0feb-6587-406e-a4ff-95a2b2dcc455 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:25.170832 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be2c0feb-6587-406e-a4ff-95a2b2dcc455 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:25.171328 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be2c0feb-6587-406e-a4ff-95a2b2dcc455 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:25.379408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-be2c0feb-6587-406e-a4ff-95a2b2dcc455 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:25.393518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-be2c0feb-6587-406e-a4ff-95a2b2dcc455 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1555 microversion: 2.1 time: 0.236386 May 24 13:23:25.394391 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 695/1396] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:25 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:23:25.532170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-cfb81162-a398-46ba-88c9-058a8b9a9f0b req-3b55b773-d2f7-42b6-b98b-99652d9ff77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db06208c-44a3-4b4b-99af-df2d5c97378d", "name": "network-vif-deleted", "tag": "f36dcd31-adf8-4ac3-8188-5f3c4d6197f3"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:23:25.543147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eb56a5cb-e160-4182-827b-d57bcd4641ee tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:25.544764 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eb56a5cb-e160-4182-827b-d57bcd4641ee tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:25.545366 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-cfb81162-a398-46ba-88c9-058a8b9a9f0b req-3b55b773-d2f7-42b6-b98b-99652d9ff77a service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:25.545824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-cfb81162-a398-46ba-88c9-058a8b9a9f0b req-3b55b773-d2f7-42b6-b98b-99652d9ff77a service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:25.557918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb56a5cb-e160-4182-827b-d57bcd4641ee tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:25.558716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-cfb81162-a398-46ba-88c9-058a8b9a9f0b req-3b55b773-d2f7-42b6-b98b-99652d9ff77a service nova] Creating event network-vif-deleted:f36dcd31-adf8-4ac3-8188-5f3c4d6197f3 for instance db06208c-44a3-4b4b-99af-df2d5c97378d on hv-cinder-84301 May 24 13:23:25.559612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb56a5cb-e160-4182-827b-d57bcd4641ee tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:25.561327 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb56a5cb-e160-4182-827b-d57bcd4641ee tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:25.563565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb56a5cb-e160-4182-827b-d57bcd4641ee tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:25.569237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-cfb81162-a398-46ba-88c9-058a8b9a9f0b req-3b55b773-d2f7-42b6-b98b-99652d9ff77a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041039 May 24 13:23:25.574848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 702/1397] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:23:25.676355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eb56a5cb-e160-4182-827b-d57bcd4641ee tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:25.688024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eb56a5cb-e160-4182-827b-d57bcd4641ee tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.150257 May 24 13:23:25.688791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 696/1398] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:25 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:23:26.411697 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:26.412910 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:26.431886 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:26.432713 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:26.434582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:26.435067 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:26.475964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:26.477506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:26.478194 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lazy-loading 'fault' on Instance uuid db06208c-44a3-4b4b-99af-df2d5c97378d {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:23:26.542505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b0a0ef7ea24caaa9540786a4d28682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8852ede3b4845b824cc9345afbb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:26.555446 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0ff358a3-5dd9-4cff-aa48-799522ff37e0 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 200 len: 1349 microversion: 2.1 time: 0.148255 May 24 13:23:26.556118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 703/1399] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:26 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 1349 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:26.705180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b52d8e2a-6091-47d0-aba0-ed31c9a16c95 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:26.705940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b52d8e2a-6091-47d0-aba0-ed31c9a16c95 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:26.713025 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b52d8e2a-6091-47d0-aba0-ed31c9a16c95 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:26.713476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b52d8e2a-6091-47d0-aba0-ed31c9a16c95 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:26.714429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b52d8e2a-6091-47d0-aba0-ed31c9a16c95 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:26.714866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b52d8e2a-6091-47d0-aba0-ed31c9a16c95 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:26.718108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:26.810594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b52d8e2a-6091-47d0-aba0-ed31c9a16c95 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:26.820005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b52d8e2a-6091-47d0-aba0-ed31c9a16c95 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.118602 May 24 13:23:26.820621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 697/1400] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:26 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:27.573455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:27.574149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] [instance: db06208c-44a3-4b4b-99af-df2d5c97378d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:27.582373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:27.583047 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:27.583891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:27.584328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:27.606034 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] HTTP exception thrown: Instance db06208c-44a3-4b4b-99af-df2d5c97378d could not be found. May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Request method failure captured: May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d HTTP/1.1 May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNj39jAwwmrjjxUGnLYW9svy1YXgGLsBw1RloPaVoF1_0DQnYJ0_xz9iZM4uRaLMBPt8uT23KjU8zxrb5GYduSDeinfIuqZWtftjIYqJJ6r7tZsYCbfSnic-uyLNA2PXWftLY1k8HY8zMUF90k6SjMvpmqNUZt-0-EwPDUq6QHgvWE4 May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 0df8852ede3b4845b824cc9345afbb5d May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-TestMinimumBasicScenario-1842788645 May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:23:27.607775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0df8852ede3b4845b824cc9345afbb5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0df8852ede3b4845b824cc9345afbb5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0df8852ede3b4845b824cc9345afbb5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0df8852ede3b4845b824cc9345afbb5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-TestMinimumBasicScenario-1842788645 May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 0df8852ede3b4845b824cc9345afbb5d May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1842788645 May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-TestMinimumBasicScenario-1842788645-project May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 66b0a0ef7ea24caaa9540786a4d28682 May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-TestMinimumBasicScenario-1842788645-project May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance db06208c-44a3-4b4b-99af-df2d5c97378d could not be found. May 24 13:23:27.609862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': 'db06208c-44a3-4b4b-99af-df2d5c97378d'} May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db06208c-44a3-4b4b-99af-df2d5c97378d could not be found. May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:23:27.611041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db06208c-44a3-4b4b-99af-df2d5c97378d could not be found. May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db06208c-44a3-4b4b-99af-df2d5c97378d could not be found. May 24 13:23:27.612657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:23:27.615434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Returning 404 to user: Instance db06208c-44a3-4b4b-99af-df2d5c97378d could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:23:27.619171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2758b75e-b129-4e21-92bb-2042ded69346 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d" status: 404 len: 111 microversion: 2.1 time: 0.049046 May 24 13:23:27.619171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 704/1401] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:27 2022] GET /compute/v2.1/servers/db06208c-44a3-4b4b-99af-df2d5c97378d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:23:27.627669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ac0160e4-9750-4014-9a21-7c8c4d3c33e7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] Calling method '.version_select at 0x7f9a66f77550>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:27.649598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ac0160e4-9750-4014-9a21-7c8c4d3c33e7 tempest-TestMinimumBasicScenario-1842788645 tempest-TestMinimumBasicScenario-1842788645-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2073671466" status: 202 len: 0 microversion: 2.1 time: 0.025747 May 24 13:23:27.650187 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 698/1402] 10.222.0.45 () {58 vars in 1271 bytes} [Tue May 24 13:23:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2073671466 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:23:27.836491 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ad6b305a-133a-4033-96da-bbdb11536fc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:27.837388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ad6b305a-133a-4033-96da-bbdb11536fc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:27.846482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad6b305a-133a-4033-96da-bbdb11536fc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:27.847208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad6b305a-133a-4033-96da-bbdb11536fc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:27.848943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad6b305a-133a-4033-96da-bbdb11536fc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:27.850207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad6b305a-133a-4033-96da-bbdb11536fc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:27.959854 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ad6b305a-133a-4033-96da-bbdb11536fc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:27.967510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ad6b305a-133a-4033-96da-bbdb11536fc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.134818 May 24 13:23:27.977248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 705/1403] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:27 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:28.986724 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0515fca6-c096-4323-b07d-d8dba818f761 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:28.987904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0515fca6-c096-4323-b07d-d8dba818f761 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:28.994146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0515fca6-c096-4323-b07d-d8dba818f761 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:28.994628 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0515fca6-c096-4323-b07d-d8dba818f761 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:28.995429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0515fca6-c096-4323-b07d-d8dba818f761 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:28.996049 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0515fca6-c096-4323-b07d-d8dba818f761 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:29.064677 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0515fca6-c096-4323-b07d-d8dba818f761 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:29.072305 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0515fca6-c096-4323-b07d-d8dba818f761 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.091996 May 24 13:23:29.073074 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 699/1404] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:28 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:30.097335 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5c911a82-7dc2-4332-9a85-2293edc4666a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:30.099530 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5c911a82-7dc2-4332-9a85-2293edc4666a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:30.112136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5c911a82-7dc2-4332-9a85-2293edc4666a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:30.112891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5c911a82-7dc2-4332-9a85-2293edc4666a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:30.114032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5c911a82-7dc2-4332-9a85-2293edc4666a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:30.114762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5c911a82-7dc2-4332-9a85-2293edc4666a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:30.217168 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5c911a82-7dc2-4332-9a85-2293edc4666a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:30.228476 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5c911a82-7dc2-4332-9a85-2293edc4666a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.140814 May 24 13:23:30.240380 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 706/1405] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:30 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:30.279861 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:23:30.280095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:23:31.255224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2dc57f06-882d-4e86-92f5-2bdb1760ddcf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:31.256130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2dc57f06-882d-4e86-92f5-2bdb1760ddcf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:31.268143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dc57f06-882d-4e86-92f5-2bdb1760ddcf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:31.269001 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dc57f06-882d-4e86-92f5-2bdb1760ddcf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:31.270334 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dc57f06-882d-4e86-92f5-2bdb1760ddcf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:31.271024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dc57f06-882d-4e86-92f5-2bdb1760ddcf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:31.378083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2dc57f06-882d-4e86-92f5-2bdb1760ddcf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:31.396919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2dc57f06-882d-4e86-92f5-2bdb1760ddcf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.147124 May 24 13:23:31.407311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 700/1406] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:31 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:32.413685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1ac9acb9-8912-4bed-ad22-5991f192ab49 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:32.415024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1ac9acb9-8912-4bed-ad22-5991f192ab49 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:32.419806 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:32.434137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ac9acb9-8912-4bed-ad22-5991f192ab49 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:32.434635 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ac9acb9-8912-4bed-ad22-5991f192ab49 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:32.441732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ac9acb9-8912-4bed-ad22-5991f192ab49 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:32.450443 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ac9acb9-8912-4bed-ad22-5991f192ab49 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:32.625957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1ac9acb9-8912-4bed-ad22-5991f192ab49 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:32.642482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1ac9acb9-8912-4bed-ad22-5991f192ab49 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.231910 May 24 13:23:32.669344 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 707/1407] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:32 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:33.676866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6edad75c-dcf9-40be-b820-72f1a1c4570e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:33.677543 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6edad75c-dcf9-40be-b820-72f1a1c4570e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:33.681104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:33.690985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6edad75c-dcf9-40be-b820-72f1a1c4570e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:33.692232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6edad75c-dcf9-40be-b820-72f1a1c4570e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:33.693922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6edad75c-dcf9-40be-b820-72f1a1c4570e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:33.697364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6edad75c-dcf9-40be-b820-72f1a1c4570e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:33.824072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6edad75c-dcf9-40be-b820-72f1a1c4570e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:33.837348 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6edad75c-dcf9-40be-b820-72f1a1c4570e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.161316 May 24 13:23:33.838573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 701/1408] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:33 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:34.856237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2abbf799-791a-479a-b694-1d5f2bbc13eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:34.857999 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2abbf799-791a-479a-b694-1d5f2bbc13eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:34.867673 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2abbf799-791a-479a-b694-1d5f2bbc13eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:34.869661 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2abbf799-791a-479a-b694-1d5f2bbc13eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:34.870728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2abbf799-791a-479a-b694-1d5f2bbc13eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:34.871502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2abbf799-791a-479a-b694-1d5f2bbc13eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:34.941494 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e69c8c36-f906-4746-a2ba-ec6ec5197677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Action: 'create', calling method: .version_select at 0x7f9a65df03a0>, body: {"keypair": {"name": "tempest-keypair-424270203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFghEZRLZ07TGEF7vkMxUpG2QRDTliDcqRW3aWKV0T9DXFaPErVo1RnA1YT31t3Bm6Tf61AD8gPU81+HvIyNknHMSjxhwrb1DiTIfIsz0JLQ81WmZgeuYZzdus6TjHNzKQ=="}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:23:34.958593 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-e69c8c36-f906-4746-a2ba-ec6ec5197677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for project cb54f85be3994a40a4b52e576b36c6da. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:23:34.963160 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-e69c8c36-f906-4746-a2ba-ec6ec5197677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for user e13a5203bc06439ba86befd2eb849ba5 and project cb54f85be3994a40a4b52e576b36c6da. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:23:35.000719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2abbf799-791a-479a-b694-1d5f2bbc13eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:35.009508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2abbf799-791a-479a-b694-1d5f2bbc13eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.157102 May 24 13:23:35.010144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e69c8c36-f906-4746-a2ba-ec6ec5197677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.210458 May 24 13:23:35.010849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 702/1409] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:34 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:35.018901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 708/1410] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 13:23:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:23:36.030820 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ff6612e2-e7c3-4c49-ab11-74661e8ae515 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:36.032070 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ff6612e2-e7c3-4c49-ab11-74661e8ae515 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:36.040485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff6612e2-e7c3-4c49-ab11-74661e8ae515 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:36.040941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff6612e2-e7c3-4c49-ab11-74661e8ae515 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:36.041718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff6612e2-e7c3-4c49-ab11-74661e8ae515 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:36.042160 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff6612e2-e7c3-4c49-ab11-74661e8ae515 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:36.114938 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff6612e2-e7c3-4c49-ab11-74661e8ae515 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:36.124523 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ff6612e2-e7c3-4c49-ab11-74661e8ae515 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.100541 May 24 13:23:36.125831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 703/1411] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:36 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:37.143545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1b294bb2-b19f-4f67-9ba9-c3f5a5f58738 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:37.144565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1b294bb2-b19f-4f67-9ba9-c3f5a5f58738 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:37.150876 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1b294bb2-b19f-4f67-9ba9-c3f5a5f58738 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:37.159912 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1b294bb2-b19f-4f67-9ba9-c3f5a5f58738 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:37.169804 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1b294bb2-b19f-4f67-9ba9-c3f5a5f58738 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:37.173864 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1b294bb2-b19f-4f67-9ba9-c3f5a5f58738 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:37.282008 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1b294bb2-b19f-4f67-9ba9-c3f5a5f58738 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:37.295369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1b294bb2-b19f-4f67-9ba9-c3f5a5f58738 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.156470 May 24 13:23:37.298198 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 709/1412] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:37 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:37.341858 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1048650508", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb5c4934-469a-4d18-945a-966849c00eff"}], "security_groups": [{"name": "tempest-securitygroup--480990257"}], "key_name": "tempest-keypair-424270203", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:23:37.466674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] validate_networks() for [('fb5c4934-469a-4d18-945a-966849c00eff', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:23:38.103811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:23:38.104432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:23:38.104916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:23:38.105341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:23:38.105756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:23:38.118743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:38.119202 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:38.120656 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:38.121132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:38.140665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for project cb54f85be3994a40a4b52e576b36c6da. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:23:38.145106 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for user e13a5203bc06439ba86befd2eb849ba5 and project cb54f85be3994a40a4b52e576b36c6da. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:23:38.157971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:23:38.160642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:23:38.215517 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e266cedb-94a1-4639-ab4d-25974ee9f751 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.877582 May 24 13:23:38.216681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 704/1413] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:23:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:23:38.226846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c3a8ddd9-0f5f-4a96-b897-c60160ba3c88 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:38.227799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c3a8ddd9-0f5f-4a96-b897-c60160ba3c88 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:38.312027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-09438d91-4cc0-4a1a-a409-7408f3682552 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:38.312754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-09438d91-4cc0-4a1a-a409-7408f3682552 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:38.326847 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09438d91-4cc0-4a1a-a409-7408f3682552 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:38.327296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09438d91-4cc0-4a1a-a409-7408f3682552 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:38.328076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09438d91-4cc0-4a1a-a409-7408f3682552 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:38.328507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09438d91-4cc0-4a1a-a409-7408f3682552 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:38.339238 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c3a8ddd9-0f5f-4a96-b897-c60160ba3c88 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:38.348790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c3a8ddd9-0f5f-4a96-b897-c60160ba3c88 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1241 microversion: 2.1 time: 0.125568 May 24 13:23:38.360107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 710/1414] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:38 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1241 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:38.421021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-09438d91-4cc0-4a1a-a409-7408f3682552 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:38.434457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-09438d91-4cc0-4a1a-a409-7408f3682552 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.125392 May 24 13:23:38.445436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 705/1415] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:38 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:39.367731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1137328f-e448-470e-923a-22f2b9aeca52 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:39.368394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1137328f-e448-470e-923a-22f2b9aeca52 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:39.376524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1137328f-e448-470e-923a-22f2b9aeca52 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:39.376988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1137328f-e448-470e-923a-22f2b9aeca52 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:39.377770 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1137328f-e448-470e-923a-22f2b9aeca52 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:39.378216 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1137328f-e448-470e-923a-22f2b9aeca52 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:39.440642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1137328f-e448-470e-923a-22f2b9aeca52 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:39.449720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1137328f-e448-470e-923a-22f2b9aeca52 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1293 microversion: 2.1 time: 0.086295 May 24 13:23:39.450328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 711/1416] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:39 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:39.453064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1f30362b-5e41-46e0-aeb7-979c219ac1e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:39.453680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1f30362b-5e41-46e0-aeb7-979c219ac1e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:39.460463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f30362b-5e41-46e0-aeb7-979c219ac1e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:39.461143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f30362b-5e41-46e0-aeb7-979c219ac1e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:39.462108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f30362b-5e41-46e0-aeb7-979c219ac1e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:39.462578 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f30362b-5e41-46e0-aeb7-979c219ac1e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:39.549334 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1f30362b-5e41-46e0-aeb7-979c219ac1e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:39.557026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1f30362b-5e41-46e0-aeb7-979c219ac1e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.107852 May 24 13:23:39.557604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 706/1417] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:39 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:23:40.467181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f10344a3-3945-43ce-9241-6f7845e12612 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:40.467814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f10344a3-3945-43ce-9241-6f7845e12612 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:40.475929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f10344a3-3945-43ce-9241-6f7845e12612 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:40.476634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f10344a3-3945-43ce-9241-6f7845e12612 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:40.477436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f10344a3-3945-43ce-9241-6f7845e12612 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:40.477991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f10344a3-3945-43ce-9241-6f7845e12612 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:40.574955 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fee9e719-4aff-411a-95d1-ac6fc8460739 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:40.576203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fee9e719-4aff-411a-95d1-ac6fc8460739 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:40.583487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fee9e719-4aff-411a-95d1-ac6fc8460739 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:40.583943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fee9e719-4aff-411a-95d1-ac6fc8460739 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:40.584729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fee9e719-4aff-411a-95d1-ac6fc8460739 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:40.585171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fee9e719-4aff-411a-95d1-ac6fc8460739 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:40.611327 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f10344a3-3945-43ce-9241-6f7845e12612 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:40.619337 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f10344a3-3945-43ce-9241-6f7845e12612 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1366 microversion: 2.1 time: 0.156249 May 24 13:23:40.619904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 712/1418] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:40 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:40.657758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fee9e719-4aff-411a-95d1-ac6fc8460739 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:40.666251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fee9e719-4aff-411a-95d1-ac6fc8460739 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.095625 May 24 13:23:40.666878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 707/1419] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:40 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:23:41.125486 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-4cbb8ccd-0762-4ac2-959c-9efc9a64f162 req-e90cee66-c659-4820-9432-c62418c6302a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ec8d2b-f986-4adc-b95a-579cfe890df5", "tag": "c935dbbc-e14b-439f-84c1-6277e77f9109"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:23:41.135565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-4cbb8ccd-0762-4ac2-959c-9efc9a64f162 req-e90cee66-c659-4820-9432-c62418c6302a service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:41.136013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-4cbb8ccd-0762-4ac2-959c-9efc9a64f162 req-e90cee66-c659-4820-9432-c62418c6302a service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:41.148961 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-4cbb8ccd-0762-4ac2-959c-9efc9a64f162 req-e90cee66-c659-4820-9432-c62418c6302a service nova] Creating event network-changed:c935dbbc-e14b-439f-84c1-6277e77f9109 for instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 on hv-cinder-84301 May 24 13:23:41.153929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-4cbb8ccd-0762-4ac2-959c-9efc9a64f162 req-e90cee66-c659-4820-9432-c62418c6302a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246846 May 24 13:23:41.154645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 713/1420] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:23:41.636521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a53e5ba-c0af-4465-bf9f-208c72fa702b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:41.637061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a53e5ba-c0af-4465-bf9f-208c72fa702b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:41.644181 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a53e5ba-c0af-4465-bf9f-208c72fa702b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:41.644639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a53e5ba-c0af-4465-bf9f-208c72fa702b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:41.645396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a53e5ba-c0af-4465-bf9f-208c72fa702b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:41.645861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a53e5ba-c0af-4465-bf9f-208c72fa702b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:41.683799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-59ede930-c93f-40e2-bbf6-d05bcabf43eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:41.684490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-59ede930-c93f-40e2-bbf6-d05bcabf43eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:41.690896 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59ede930-c93f-40e2-bbf6-d05bcabf43eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:41.691344 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59ede930-c93f-40e2-bbf6-d05bcabf43eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:41.692106 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59ede930-c93f-40e2-bbf6-d05bcabf43eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:41.692543 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59ede930-c93f-40e2-bbf6-d05bcabf43eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:41.754503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-59ede930-c93f-40e2-bbf6-d05bcabf43eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:41.761976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-59ede930-c93f-40e2-bbf6-d05bcabf43eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082738 May 24 13:23:41.762559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 714/1421] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:41 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:41.778654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a53e5ba-c0af-4465-bf9f-208c72fa702b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:41.786597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a53e5ba-c0af-4465-bf9f-208c72fa702b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1366 microversion: 2.1 time: 0.153974 May 24 13:23:41.787168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 708/1422] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:41 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:42.779424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-483beae6-a03d-418d-83cb-8e87afd9e488 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:42.780123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-483beae6-a03d-418d-83cb-8e87afd9e488 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:42.787510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-483beae6-a03d-418d-83cb-8e87afd9e488 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:42.787983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-483beae6-a03d-418d-83cb-8e87afd9e488 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:42.788731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-483beae6-a03d-418d-83cb-8e87afd9e488 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:42.789170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-483beae6-a03d-418d-83cb-8e87afd9e488 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:42.803974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5f043de6-7914-4512-87d2-85eafc608e4d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:42.804586 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5f043de6-7914-4512-87d2-85eafc608e4d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:42.811480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f043de6-7914-4512-87d2-85eafc608e4d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:42.812185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f043de6-7914-4512-87d2-85eafc608e4d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:42.812965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f043de6-7914-4512-87d2-85eafc608e4d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:42.813413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f043de6-7914-4512-87d2-85eafc608e4d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:42.856348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-483beae6-a03d-418d-83cb-8e87afd9e488 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:42.865152 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-483beae6-a03d-418d-83cb-8e87afd9e488 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.089575 May 24 13:23:42.865835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 715/1423] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:42 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:42.947428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5f043de6-7914-4512-87d2-85eafc608e4d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:42.954876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5f043de6-7914-4512-87d2-85eafc608e4d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1366 microversion: 2.1 time: 0.154787 May 24 13:23:42.955447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 709/1424] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:42 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:23:43.882018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2c0f8e6d-3367-4a3a-80e6-24dae0499a9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:43.882671 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2c0f8e6d-3367-4a3a-80e6-24dae0499a9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:43.889410 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c0f8e6d-3367-4a3a-80e6-24dae0499a9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:43.889801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c0f8e6d-3367-4a3a-80e6-24dae0499a9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:43.890596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c0f8e6d-3367-4a3a-80e6-24dae0499a9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:43.891029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c0f8e6d-3367-4a3a-80e6-24dae0499a9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:43.955020 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2c0f8e6d-3367-4a3a-80e6-24dae0499a9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:43.962682 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2c0f8e6d-3367-4a3a-80e6-24dae0499a9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084437 May 24 13:23:43.963257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 716/1425] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:43 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:43.971994 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a0c4eb04-fda1-4a98-a7ec-21b3df7e5f9a tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:43.972689 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a0c4eb04-fda1-4a98-a7ec-21b3df7e5f9a tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:43.979098 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a0c4eb04-fda1-4a98-a7ec-21b3df7e5f9a tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:43.979539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a0c4eb04-fda1-4a98-a7ec-21b3df7e5f9a tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:43.980291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a0c4eb04-fda1-4a98-a7ec-21b3df7e5f9a tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:43.980719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a0c4eb04-fda1-4a98-a7ec-21b3df7e5f9a tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:44.108103 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a0c4eb04-fda1-4a98-a7ec-21b3df7e5f9a tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:44.115700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a0c4eb04-fda1-4a98-a7ec-21b3df7e5f9a tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1366 microversion: 2.1 time: 0.148147 May 24 13:23:44.116269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 710/1426] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:43 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:44.979558 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c2bdceff-3775-476b-b67c-8393da7a04c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:44.980178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c2bdceff-3775-476b-b67c-8393da7a04c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:44.987556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c2bdceff-3775-476b-b67c-8393da7a04c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:44.988004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c2bdceff-3775-476b-b67c-8393da7a04c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:44.988771 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c2bdceff-3775-476b-b67c-8393da7a04c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:44.989210 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c2bdceff-3775-476b-b67c-8393da7a04c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:45.049525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c2bdceff-3775-476b-b67c-8393da7a04c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:45.057250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c2bdceff-3775-476b-b67c-8393da7a04c7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081484 May 24 13:23:45.057828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 717/1427] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:44 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:45.132585 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ebc13e96-a1fd-4f05-94b5-7d79b9d2b80c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:45.133150 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ebc13e96-a1fd-4f05-94b5-7d79b9d2b80c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:45.139527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebc13e96-a1fd-4f05-94b5-7d79b9d2b80c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:45.139979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebc13e96-a1fd-4f05-94b5-7d79b9d2b80c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:45.140740 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebc13e96-a1fd-4f05-94b5-7d79b9d2b80c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:45.141170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ebc13e96-a1fd-4f05-94b5-7d79b9d2b80c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:45.269335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ebc13e96-a1fd-4f05-94b5-7d79b9d2b80c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:45.278121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ebc13e96-a1fd-4f05-94b5-7d79b9d2b80c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1366 microversion: 2.1 time: 0.149447 May 24 13:23:45.278744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 711/1428] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:45 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:46.073328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3ef417fc-9f8f-4569-ac86-5dffe254e88c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:46.073958 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3ef417fc-9f8f-4569-ac86-5dffe254e88c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:46.081158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ef417fc-9f8f-4569-ac86-5dffe254e88c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:46.081607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ef417fc-9f8f-4569-ac86-5dffe254e88c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:46.082401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ef417fc-9f8f-4569-ac86-5dffe254e88c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:46.082845 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ef417fc-9f8f-4569-ac86-5dffe254e88c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:46.143923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3ef417fc-9f8f-4569-ac86-5dffe254e88c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:46.146254 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:46.153035 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3ef417fc-9f8f-4569-ac86-5dffe254e88c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083657 May 24 13:23:46.153894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 718/1429] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:46 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:46.294908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d831642b-c1fc-4934-9d4e-09d5261bbf14 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:46.295524 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d831642b-c1fc-4934-9d4e-09d5261bbf14 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:46.302577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d831642b-c1fc-4934-9d4e-09d5261bbf14 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:46.303026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d831642b-c1fc-4934-9d4e-09d5261bbf14 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:46.303785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d831642b-c1fc-4934-9d4e-09d5261bbf14 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:46.304219 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d831642b-c1fc-4934-9d4e-09d5261bbf14 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:46.677233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d831642b-c1fc-4934-9d4e-09d5261bbf14 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:46.684630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d831642b-c1fc-4934-9d4e-09d5261bbf14 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1366 microversion: 2.1 time: 0.393627 May 24 13:23:46.685199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 712/1430] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:46 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:47.172087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ce74a810-cc7b-4ca3-9657-6dfa4956bbff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:47.173458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ce74a810-cc7b-4ca3-9657-6dfa4956bbff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:47.181367 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce74a810-cc7b-4ca3-9657-6dfa4956bbff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:47.182368 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce74a810-cc7b-4ca3-9657-6dfa4956bbff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:47.183649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce74a810-cc7b-4ca3-9657-6dfa4956bbff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:47.184117 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce74a810-cc7b-4ca3-9657-6dfa4956bbff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:47.254742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ce74a810-cc7b-4ca3-9657-6dfa4956bbff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:47.262208 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-6932907e-add6-46f6-a83b-0f3c00cd8cc6 req-2f2ac786-1799-46bc-80f0-f38c73cd4b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ec8d2b-f986-4adc-b95a-579cfe890df5", "name": "network-vif-plugged", "status": "completed", "tag": "c935dbbc-e14b-439f-84c1-6277e77f9109"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:23:47.263325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ce74a810-cc7b-4ca3-9657-6dfa4956bbff tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.096888 May 24 13:23:47.264478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 719/1431] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:47 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:47.277853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6932907e-add6-46f6-a83b-0f3c00cd8cc6 req-2f2ac786-1799-46bc-80f0-f38c73cd4b7a service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:47.278384 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6932907e-add6-46f6-a83b-0f3c00cd8cc6 req-2f2ac786-1799-46bc-80f0-f38c73cd4b7a service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:47.289021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-6932907e-add6-46f6-a83b-0f3c00cd8cc6 req-2f2ac786-1799-46bc-80f0-f38c73cd4b7a service nova] Creating event network-vif-plugged:c935dbbc-e14b-439f-84c1-6277e77f9109 for instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 on hv-cinder-84301 May 24 13:23:47.294649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-6932907e-add6-46f6-a83b-0f3c00cd8cc6 req-2f2ac786-1799-46bc-80f0-f38c73cd4b7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102048 May 24 13:23:47.295235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 713/1432] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:23:47.701504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8f23e0f3-d92e-4d8e-8f41-bd40e6be3639 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:47.702114 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8f23e0f3-d92e-4d8e-8f41-bd40e6be3639 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:47.708618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f23e0f3-d92e-4d8e-8f41-bd40e6be3639 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:47.709061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f23e0f3-d92e-4d8e-8f41-bd40e6be3639 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:47.709812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f23e0f3-d92e-4d8e-8f41-bd40e6be3639 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:47.710250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8f23e0f3-d92e-4d8e-8f41-bd40e6be3639 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:47.837888 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8f23e0f3-d92e-4d8e-8f41-bd40e6be3639 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:47.845797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8f23e0f3-d92e-4d8e-8f41-bd40e6be3639 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1366 microversion: 2.1 time: 0.148207 May 24 13:23:47.846381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 720/1433] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:47 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:48.281205 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-660a1f03-5653-4d45-85dd-4c37fb8d08df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:48.282468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-660a1f03-5653-4d45-85dd-4c37fb8d08df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:48.284589 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:48.285237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:48.291751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-660a1f03-5653-4d45-85dd-4c37fb8d08df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:48.292201 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-660a1f03-5653-4d45-85dd-4c37fb8d08df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:48.292964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-660a1f03-5653-4d45-85dd-4c37fb8d08df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:48.293400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-660a1f03-5653-4d45-85dd-4c37fb8d08df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:48.353788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-660a1f03-5653-4d45-85dd-4c37fb8d08df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:48.361465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-660a1f03-5653-4d45-85dd-4c37fb8d08df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084486 May 24 13:23:48.362037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 714/1434] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:48 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:48.862901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f88b759c-a705-42dc-a7b4-fbd6558db3da tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:48.863435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f88b759c-a705-42dc-a7b4-fbd6558db3da tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:48.865703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=6 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:48.871385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f88b759c-a705-42dc-a7b4-fbd6558db3da tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:48.871843 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f88b759c-a705-42dc-a7b4-fbd6558db3da tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:48.872618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f88b759c-a705-42dc-a7b4-fbd6558db3da tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:48.873057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f88b759c-a705-42dc-a7b4-fbd6558db3da tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:49.002222 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f88b759c-a705-42dc-a7b4-fbd6558db3da tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:49.009634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f88b759c-a705-42dc-a7b4-fbd6558db3da tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1556 microversion: 2.1 time: 0.151066 May 24 13:23:49.010195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 721/1435] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:48 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:49.025992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-10b838a4-61a5-4af6-aea7-5b9b02f3f1d3 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:49.026513 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-10b838a4-61a5-4af6-aea7-5b9b02f3f1d3 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:49.032404 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b838a4-61a5-4af6-aea7-5b9b02f3f1d3 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:49.032848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b838a4-61a5-4af6-aea7-5b9b02f3f1d3 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:49.033599 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b838a4-61a5-4af6-aea7-5b9b02f3f1d3 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:49.034030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b838a4-61a5-4af6-aea7-5b9b02f3f1d3 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:49.111804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-10b838a4-61a5-4af6-aea7-5b9b02f3f1d3 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089549 May 24 13:23:49.112392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 715/1436] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 13:23:49 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:23:49.380926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b22b2cf6-b2f2-45d2-976c-d826eeac10f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:49.381534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b22b2cf6-b2f2-45d2-976c-d826eeac10f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:49.392273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b22b2cf6-b2f2-45d2-976c-d826eeac10f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:49.392723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b22b2cf6-b2f2-45d2-976c-d826eeac10f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:49.393699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b22b2cf6-b2f2-45d2-976c-d826eeac10f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:49.395121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b22b2cf6-b2f2-45d2-976c-d826eeac10f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:49.457727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b22b2cf6-b2f2-45d2-976c-d826eeac10f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:49.465560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b22b2cf6-b2f2-45d2-976c-d826eeac10f0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.090566 May 24 13:23:49.466133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 722/1437] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:49 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:50.009625 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-870afae4-fae9-4d1c-818d-be782abbab50 req-c6abf731-47f6-46d5-b0ec-e60d139e0954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ec8d2b-f986-4adc-b95a-579cfe890df5", "tag": "c935dbbc-e14b-439f-84c1-6277e77f9109"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:23:50.017567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-870afae4-fae9-4d1c-818d-be782abbab50 req-c6abf731-47f6-46d5-b0ec-e60d139e0954 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:50.018010 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-870afae4-fae9-4d1c-818d-be782abbab50 req-c6abf731-47f6-46d5-b0ec-e60d139e0954 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:50.030710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-870afae4-fae9-4d1c-818d-be782abbab50 req-c6abf731-47f6-46d5-b0ec-e60d139e0954 service nova] Creating event network-changed:c935dbbc-e14b-439f-84c1-6277e77f9109 for instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 on hv-cinder-84301 May 24 13:23:50.035768 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-870afae4-fae9-4d1c-818d-be782abbab50 req-c6abf731-47f6-46d5-b0ec-e60d139e0954 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030244 May 24 13:23:50.036351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 716/1438] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:23:50.483444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-74189558-6266-42b0-ae3c-823fca0b2f38 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:50.484382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-74189558-6266-42b0-ae3c-823fca0b2f38 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:50.491707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-74189558-6266-42b0-ae3c-823fca0b2f38 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:50.492586 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-74189558-6266-42b0-ae3c-823fca0b2f38 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:50.492917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-74189558-6266-42b0-ae3c-823fca0b2f38 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:50.493347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-74189558-6266-42b0-ae3c-823fca0b2f38 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:50.559187 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-74189558-6266-42b0-ae3c-823fca0b2f38 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:50.566923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-74189558-6266-42b0-ae3c-823fca0b2f38 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.087651 May 24 13:23:50.567490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 723/1439] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:50 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:51.584992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d9c11241-936c-42d9-844e-2359feb8871b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:51.585703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d9c11241-936c-42d9-844e-2359feb8871b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:51.591993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9c11241-936c-42d9-844e-2359feb8871b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:51.592449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9c11241-936c-42d9-844e-2359feb8871b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:51.593224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9c11241-936c-42d9-844e-2359feb8871b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:51.593661 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9c11241-936c-42d9-844e-2359feb8871b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:51.596296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:23:51.657170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d9c11241-936c-42d9-844e-2359feb8871b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:51.665674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d9c11241-936c-42d9-844e-2359feb8871b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085400 May 24 13:23:51.666221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 717/1440] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:51 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:52.684374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2de833bc-e244-488e-9791-da9d622084ea tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:52.685545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2de833bc-e244-488e-9791-da9d622084ea tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:52.692906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2de833bc-e244-488e-9791-da9d622084ea tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:52.693354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2de833bc-e244-488e-9791-da9d622084ea tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:52.694119 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2de833bc-e244-488e-9791-da9d622084ea tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:52.694758 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2de833bc-e244-488e-9791-da9d622084ea tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:52.757966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2de833bc-e244-488e-9791-da9d622084ea tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:52.765520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2de833bc-e244-488e-9791-da9d622084ea tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085049 May 24 13:23:52.766092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 724/1441] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:52 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:23:53.782240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7c7f848f-a786-4f92-8584-86ca0373deec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:53.782878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7c7f848f-a786-4f92-8584-86ca0373deec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:53.789317 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c7f848f-a786-4f92-8584-86ca0373deec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:53.789759 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c7f848f-a786-4f92-8584-86ca0373deec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:53.790540 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c7f848f-a786-4f92-8584-86ca0373deec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:53.790968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c7f848f-a786-4f92-8584-86ca0373deec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:53.854669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7c7f848f-a786-4f92-8584-86ca0373deec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:53.863073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7c7f848f-a786-4f92-8584-86ca0373deec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084727 May 24 13:23:53.863637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 718/1442] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:53 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:54.880464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-871bc54d-1738-4bb9-a2ca-b7d213f5219e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:54.881074 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-871bc54d-1738-4bb9-a2ca-b7d213f5219e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:54.887565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-871bc54d-1738-4bb9-a2ca-b7d213f5219e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:54.888019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-871bc54d-1738-4bb9-a2ca-b7d213f5219e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:54.888793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-871bc54d-1738-4bb9-a2ca-b7d213f5219e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:54.889233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-871bc54d-1738-4bb9-a2ca-b7d213f5219e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:54.949658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-871bc54d-1738-4bb9-a2ca-b7d213f5219e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:54.957929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-871bc54d-1738-4bb9-a2ca-b7d213f5219e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081862 May 24 13:23:54.958541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 725/1443] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:54 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:55.974913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f5dfbd1d-c203-4bce-82e0-44070ec65022 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:55.975527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f5dfbd1d-c203-4bce-82e0-44070ec65022 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:55.982030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5dfbd1d-c203-4bce-82e0-44070ec65022 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:55.982512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5dfbd1d-c203-4bce-82e0-44070ec65022 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:55.983272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5dfbd1d-c203-4bce-82e0-44070ec65022 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:55.983704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5dfbd1d-c203-4bce-82e0-44070ec65022 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:56.045807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f5dfbd1d-c203-4bce-82e0-44070ec65022 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:56.054154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f5dfbd1d-c203-4bce-82e0-44070ec65022 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083147 May 24 13:23:56.054744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 719/1444] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:55 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:57.071223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d45b09b0-cecc-47a4-8045-847f9fa074bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:57.071849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d45b09b0-cecc-47a4-8045-847f9fa074bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:57.078519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d45b09b0-cecc-47a4-8045-847f9fa074bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:57.079165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d45b09b0-cecc-47a4-8045-847f9fa074bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:57.080781 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d45b09b0-cecc-47a4-8045-847f9fa074bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:57.081233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d45b09b0-cecc-47a4-8045-847f9fa074bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:57.147243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d45b09b0-cecc-47a4-8045-847f9fa074bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:57.155000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d45b09b0-cecc-47a4-8045-847f9fa074bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.087937 May 24 13:23:57.155566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 726/1445] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:57 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:58.172346 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-352cf553-2934-4001-a06f-b078cbafb451 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:58.172955 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-352cf553-2934-4001-a06f-b078cbafb451 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:58.179421 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-352cf553-2934-4001-a06f-b078cbafb451 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:58.179866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-352cf553-2934-4001-a06f-b078cbafb451 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:58.180621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-352cf553-2934-4001-a06f-b078cbafb451 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:58.181068 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-352cf553-2934-4001-a06f-b078cbafb451 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:58.240467 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-352cf553-2934-4001-a06f-b078cbafb451 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:58.247804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-352cf553-2934-4001-a06f-b078cbafb451 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079387 May 24 13:23:58.248368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 720/1446] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:58 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:23:59.264662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-590ad265-fda7-4b94-acc8-f5cc2f464ad3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:23:59.265404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-590ad265-fda7-4b94-acc8-f5cc2f464ad3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:23:59.272608 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-590ad265-fda7-4b94-acc8-f5cc2f464ad3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:59.273084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-590ad265-fda7-4b94-acc8-f5cc2f464ad3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:59.273867 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-590ad265-fda7-4b94-acc8-f5cc2f464ad3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:23:59.274332 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-590ad265-fda7-4b94-acc8-f5cc2f464ad3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:23:59.336216 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-590ad265-fda7-4b94-acc8-f5cc2f464ad3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:23:59.343684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-590ad265-fda7-4b94-acc8-f5cc2f464ad3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082951 May 24 13:23:59.344248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 727/1447] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:23:59 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:00.359927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-99a4bb4a-013f-497c-b310-f2e658dc2d5d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:00.361052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-99a4bb4a-013f-497c-b310-f2e658dc2d5d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:00.367739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99a4bb4a-013f-497c-b310-f2e658dc2d5d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:00.368157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99a4bb4a-013f-497c-b310-f2e658dc2d5d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:00.368953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99a4bb4a-013f-497c-b310-f2e658dc2d5d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:00.369395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99a4bb4a-013f-497c-b310-f2e658dc2d5d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:00.429637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-99a4bb4a-013f-497c-b310-f2e658dc2d5d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:00.437238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-99a4bb4a-013f-497c-b310-f2e658dc2d5d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081555 May 24 13:24:00.437807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 721/1448] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:00 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:01.455366 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ea921160-f520-43d7-b21c-4ddf433fdc13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:01.455988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ea921160-f520-43d7-b21c-4ddf433fdc13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:01.462566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea921160-f520-43d7-b21c-4ddf433fdc13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:01.463018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea921160-f520-43d7-b21c-4ddf433fdc13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:01.463782 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea921160-f520-43d7-b21c-4ddf433fdc13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:01.464220 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea921160-f520-43d7-b21c-4ddf433fdc13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:01.526998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ea921160-f520-43d7-b21c-4ddf433fdc13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:01.534360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ea921160-f520-43d7-b21c-4ddf433fdc13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083526 May 24 13:24:01.534912 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 728/1449] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:01 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:02.551807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7abbb0a4-a742-4796-8feb-15b277168230 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:02.552361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7abbb0a4-a742-4796-8feb-15b277168230 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:02.558880 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7abbb0a4-a742-4796-8feb-15b277168230 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:02.559329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7abbb0a4-a742-4796-8feb-15b277168230 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:02.560091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7abbb0a4-a742-4796-8feb-15b277168230 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:02.560526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7abbb0a4-a742-4796-8feb-15b277168230 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:02.625302 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7abbb0a4-a742-4796-8feb-15b277168230 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:02.633449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7abbb0a4-a742-4796-8feb-15b277168230 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.086130 May 24 13:24:02.634015 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 722/1450] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:02 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:03.650226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5747b9f5-9f35-455f-941e-e2ac46c5767f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:03.650872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5747b9f5-9f35-455f-941e-e2ac46c5767f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:03.653188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:24:03.659273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5747b9f5-9f35-455f-941e-e2ac46c5767f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:03.659671 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5747b9f5-9f35-455f-941e-e2ac46c5767f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:03.660439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5747b9f5-9f35-455f-941e-e2ac46c5767f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:03.660880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5747b9f5-9f35-455f-941e-e2ac46c5767f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:03.721172 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5747b9f5-9f35-455f-941e-e2ac46c5767f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:03.728710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5747b9f5-9f35-455f-941e-e2ac46c5767f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082398 May 24 13:24:03.729276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 729/1451] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:03 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:04.745886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f2bd58fd-ef8d-444e-9365-9ad87bb5c173 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:04.746526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f2bd58fd-ef8d-444e-9365-9ad87bb5c173 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:04.748834 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:24:04.754637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2bd58fd-ef8d-444e-9365-9ad87bb5c173 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:04.755086 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2bd58fd-ef8d-444e-9365-9ad87bb5c173 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:04.755840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2bd58fd-ef8d-444e-9365-9ad87bb5c173 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:04.756271 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2bd58fd-ef8d-444e-9365-9ad87bb5c173 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:04.816645 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f2bd58fd-ef8d-444e-9365-9ad87bb5c173 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:04.824026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f2bd58fd-ef8d-444e-9365-9ad87bb5c173 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082080 May 24 13:24:04.824624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 723/1452] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:04 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:05.840943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-527e81a6-430f-4644-8a59-5e1b11bf82e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:05.841573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-527e81a6-430f-4644-8a59-5e1b11bf82e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:05.848639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-527e81a6-430f-4644-8a59-5e1b11bf82e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:05.849088 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-527e81a6-430f-4644-8a59-5e1b11bf82e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:05.849850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-527e81a6-430f-4644-8a59-5e1b11bf82e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:05.850308 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-527e81a6-430f-4644-8a59-5e1b11bf82e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:05.910406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-527e81a6-430f-4644-8a59-5e1b11bf82e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:05.917810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-527e81a6-430f-4644-8a59-5e1b11bf82e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080776 May 24 13:24:05.918395 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 730/1453] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:05 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:06.935160 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2cafc120-bef1-4de6-b527-2e6f3135f406 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:06.935802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2cafc120-bef1-4de6-b527-2e6f3135f406 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:06.942783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cafc120-bef1-4de6-b527-2e6f3135f406 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:06.943225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cafc120-bef1-4de6-b527-2e6f3135f406 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:06.943977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cafc120-bef1-4de6-b527-2e6f3135f406 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:06.944406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cafc120-bef1-4de6-b527-2e6f3135f406 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:07.003733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2cafc120-bef1-4de6-b527-2e6f3135f406 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:07.011113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2cafc120-bef1-4de6-b527-2e6f3135f406 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079788 May 24 13:24:07.011704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 724/1454] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:06 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:08.028478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cedd3a1f-27ec-459b-9d1e-12cc6da035b9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:08.029093 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cedd3a1f-27ec-459b-9d1e-12cc6da035b9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:08.035749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cedd3a1f-27ec-459b-9d1e-12cc6da035b9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:08.036199 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cedd3a1f-27ec-459b-9d1e-12cc6da035b9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:08.036956 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cedd3a1f-27ec-459b-9d1e-12cc6da035b9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:08.037390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cedd3a1f-27ec-459b-9d1e-12cc6da035b9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:08.097743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cedd3a1f-27ec-459b-9d1e-12cc6da035b9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:08.105451 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cedd3a1f-27ec-459b-9d1e-12cc6da035b9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080801 May 24 13:24:08.106009 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 731/1455] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:08 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:09.123203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6966e67f-9c3e-4cee-bc4b-74c830f44e9c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:09.123822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6966e67f-9c3e-4cee-bc4b-74c830f44e9c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:09.130296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6966e67f-9c3e-4cee-bc4b-74c830f44e9c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:09.130757 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6966e67f-9c3e-4cee-bc4b-74c830f44e9c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:09.131520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6966e67f-9c3e-4cee-bc4b-74c830f44e9c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:09.131955 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6966e67f-9c3e-4cee-bc4b-74c830f44e9c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:09.191556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6966e67f-9c3e-4cee-bc4b-74c830f44e9c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:09.198962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6966e67f-9c3e-4cee-bc4b-74c830f44e9c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079599 May 24 13:24:09.199527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 725/1456] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:09 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:10.215803 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-89ba9bf4-92bf-41ca-8986-2695ca1cd2f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:10.216484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-89ba9bf4-92bf-41ca-8986-2695ca1cd2f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:10.223687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-89ba9bf4-92bf-41ca-8986-2695ca1cd2f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:10.224138 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-89ba9bf4-92bf-41ca-8986-2695ca1cd2f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:10.224894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-89ba9bf4-92bf-41ca-8986-2695ca1cd2f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:10.225324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-89ba9bf4-92bf-41ca-8986-2695ca1cd2f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:10.288498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-89ba9bf4-92bf-41ca-8986-2695ca1cd2f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:10.295936 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-89ba9bf4-92bf-41ca-8986-2695ca1cd2f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084023 May 24 13:24:10.296499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 732/1457] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:10 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:11.312005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-55c400c7-d391-4029-9f95-17cadb0f4684 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:11.312619 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-55c400c7-d391-4029-9f95-17cadb0f4684 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:11.319110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55c400c7-d391-4029-9f95-17cadb0f4684 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:11.319553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55c400c7-d391-4029-9f95-17cadb0f4684 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:11.320299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55c400c7-d391-4029-9f95-17cadb0f4684 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:11.320725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55c400c7-d391-4029-9f95-17cadb0f4684 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:11.383043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-55c400c7-d391-4029-9f95-17cadb0f4684 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:11.390846 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-55c400c7-d391-4029-9f95-17cadb0f4684 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082738 May 24 13:24:11.391428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 726/1458] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:11 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:12.407263 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e83567ed-1d39-4290-b094-4666ffdcbc7c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:12.407672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e83567ed-1d39-4290-b094-4666ffdcbc7c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:12.415768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83567ed-1d39-4290-b094-4666ffdcbc7c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:12.417397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83567ed-1d39-4290-b094-4666ffdcbc7c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:12.418774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83567ed-1d39-4290-b094-4666ffdcbc7c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:12.419591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e83567ed-1d39-4290-b094-4666ffdcbc7c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:12.481024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e83567ed-1d39-4290-b094-4666ffdcbc7c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:12.489241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e83567ed-1d39-4290-b094-4666ffdcbc7c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.086290 May 24 13:24:12.489823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 733/1459] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:12 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:13.506613 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0bd3e999-1491-4d98-80d1-34fb7527e997 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:13.507215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0bd3e999-1491-4d98-80d1-34fb7527e997 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:13.513599 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd3e999-1491-4d98-80d1-34fb7527e997 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:13.514047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd3e999-1491-4d98-80d1-34fb7527e997 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:13.514837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd3e999-1491-4d98-80d1-34fb7527e997 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:13.515273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd3e999-1491-4d98-80d1-34fb7527e997 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:13.574458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0bd3e999-1491-4d98-80d1-34fb7527e997 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:13.582600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0bd3e999-1491-4d98-80d1-34fb7527e997 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079738 May 24 13:24:13.583164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 727/1460] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:13 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:14.599965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1100dbc2-e8e3-452f-a105-f398a459e837 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:14.600582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1100dbc2-e8e3-452f-a105-f398a459e837 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:14.608925 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1100dbc2-e8e3-452f-a105-f398a459e837 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:14.608925 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1100dbc2-e8e3-452f-a105-f398a459e837 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:14.609388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1100dbc2-e8e3-452f-a105-f398a459e837 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:14.609824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1100dbc2-e8e3-452f-a105-f398a459e837 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:14.672375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1100dbc2-e8e3-452f-a105-f398a459e837 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:14.679828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1100dbc2-e8e3-452f-a105-f398a459e837 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083716 May 24 13:24:14.680386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 734/1461] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:14 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:24:15.697012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-28d676af-7c46-45c7-aa0d-be73bcb692d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:15.697565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-28d676af-7c46-45c7-aa0d-be73bcb692d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:15.704708 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28d676af-7c46-45c7-aa0d-be73bcb692d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:15.705159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28d676af-7c46-45c7-aa0d-be73bcb692d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:15.705916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28d676af-7c46-45c7-aa0d-be73bcb692d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:15.706384 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28d676af-7c46-45c7-aa0d-be73bcb692d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:15.765741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-28d676af-7c46-45c7-aa0d-be73bcb692d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:15.773790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-28d676af-7c46-45c7-aa0d-be73bcb692d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080739 May 24 13:24:15.774372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 728/1462] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:15 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:16.791227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f9c40c71-d4da-4dae-8964-9bf9b8559a3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:16.791828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f9c40c71-d4da-4dae-8964-9bf9b8559a3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:16.798502 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f9c40c71-d4da-4dae-8964-9bf9b8559a3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:16.798950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f9c40c71-d4da-4dae-8964-9bf9b8559a3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:16.799707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f9c40c71-d4da-4dae-8964-9bf9b8559a3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:16.800141 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f9c40c71-d4da-4dae-8964-9bf9b8559a3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:16.814581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:24:16.861499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f9c40c71-d4da-4dae-8964-9bf9b8559a3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:16.868825 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f9c40c71-d4da-4dae-8964-9bf9b8559a3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081640 May 24 13:24:16.869380 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 735/1463] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:16 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:17.885496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d54a3b84-c90f-44b8-8e27-b4c79adcd5fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:17.886112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d54a3b84-c90f-44b8-8e27-b4c79adcd5fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:17.892784 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d54a3b84-c90f-44b8-8e27-b4c79adcd5fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:17.893233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d54a3b84-c90f-44b8-8e27-b4c79adcd5fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:17.893987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d54a3b84-c90f-44b8-8e27-b4c79adcd5fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:17.894451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d54a3b84-c90f-44b8-8e27-b4c79adcd5fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:17.955910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d54a3b84-c90f-44b8-8e27-b4c79adcd5fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:17.963223 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d54a3b84-c90f-44b8-8e27-b4c79adcd5fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081560 May 24 13:24:17.963790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 729/1464] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:17 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:18.980097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-38c3e9ac-4d49-460e-a48e-bd05be67226d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:18.980740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-38c3e9ac-4d49-460e-a48e-bd05be67226d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:18.987447 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38c3e9ac-4d49-460e-a48e-bd05be67226d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:18.987893 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38c3e9ac-4d49-460e-a48e-bd05be67226d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:18.988641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38c3e9ac-4d49-460e-a48e-bd05be67226d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:18.989072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38c3e9ac-4d49-460e-a48e-bd05be67226d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:19.051546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-38c3e9ac-4d49-460e-a48e-bd05be67226d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:19.058951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-38c3e9ac-4d49-460e-a48e-bd05be67226d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082675 May 24 13:24:19.059511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 736/1465] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:18 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:20.076575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1001e37f-30f1-431f-b7fd-2c67c8280533 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:20.077835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1001e37f-30f1-431f-b7fd-2c67c8280533 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:20.085191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1001e37f-30f1-431f-b7fd-2c67c8280533 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:20.085692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1001e37f-30f1-431f-b7fd-2c67c8280533 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:20.086485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1001e37f-30f1-431f-b7fd-2c67c8280533 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:20.086921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1001e37f-30f1-431f-b7fd-2c67c8280533 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:20.150574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1001e37f-30f1-431f-b7fd-2c67c8280533 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:20.158790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1001e37f-30f1-431f-b7fd-2c67c8280533 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.086044 May 24 13:24:20.159363 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 730/1466] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:20 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:21.175458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-63ac40b8-0585-4e2b-8829-2fee4590b89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:21.176103 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-63ac40b8-0585-4e2b-8829-2fee4590b89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:21.182903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63ac40b8-0585-4e2b-8829-2fee4590b89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:21.183369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63ac40b8-0585-4e2b-8829-2fee4590b89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:21.184116 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63ac40b8-0585-4e2b-8829-2fee4590b89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:21.184549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-63ac40b8-0585-4e2b-8829-2fee4590b89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:21.244216 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-63ac40b8-0585-4e2b-8829-2fee4590b89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:21.252123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-63ac40b8-0585-4e2b-8829-2fee4590b89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080657 May 24 13:24:21.252682 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 737/1467] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:21 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:24:22.395660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e6d7303-40ae-4360-84c7-d5fe8a6a7d06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:22.396281 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e6d7303-40ae-4360-84c7-d5fe8a6a7d06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:22.402269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e6d7303-40ae-4360-84c7-d5fe8a6a7d06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:22.402743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e6d7303-40ae-4360-84c7-d5fe8a6a7d06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:22.403503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e6d7303-40ae-4360-84c7-d5fe8a6a7d06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:22.403938 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e6d7303-40ae-4360-84c7-d5fe8a6a7d06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:22.406508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=84 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:24:22.466106 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e6d7303-40ae-4360-84c7-d5fe8a6a7d06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:22.473592 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e6d7303-40ae-4360-84c7-d5fe8a6a7d06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.208625 May 24 13:24:22.474161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 731/1468] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:22 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:23.490457 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2691236d-32ab-426e-a304-862f5e8c4672 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:23.491100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2691236d-32ab-426e-a304-862f5e8c4672 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:23.497586 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2691236d-32ab-426e-a304-862f5e8c4672 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:23.498030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2691236d-32ab-426e-a304-862f5e8c4672 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:23.498814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2691236d-32ab-426e-a304-862f5e8c4672 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:23.499247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2691236d-32ab-426e-a304-862f5e8c4672 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:23.558720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2691236d-32ab-426e-a304-862f5e8c4672 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:23.566745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2691236d-32ab-426e-a304-862f5e8c4672 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080155 May 24 13:24:23.567311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 738/1469] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:23 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:24.584040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-68abf483-d66f-4925-80dc-7dc752db9045 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:24.584654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-68abf483-d66f-4925-80dc-7dc752db9045 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:24.591222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68abf483-d66f-4925-80dc-7dc752db9045 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:24.591679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68abf483-d66f-4925-80dc-7dc752db9045 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:24.592430 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68abf483-d66f-4925-80dc-7dc752db9045 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:24.592948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68abf483-d66f-4925-80dc-7dc752db9045 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:24.651954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68abf483-d66f-4925-80dc-7dc752db9045 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:24.659976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-68abf483-d66f-4925-80dc-7dc752db9045 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079825 May 24 13:24:24.660534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 732/1470] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:24 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:25.676684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b5268af4-c9e1-4fd6-9246-bd930c228b55 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:25.677283 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b5268af4-c9e1-4fd6-9246-bd930c228b55 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:25.683797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5268af4-c9e1-4fd6-9246-bd930c228b55 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:25.684249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5268af4-c9e1-4fd6-9246-bd930c228b55 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:25.685012 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5268af4-c9e1-4fd6-9246-bd930c228b55 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:25.685450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5268af4-c9e1-4fd6-9246-bd930c228b55 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:25.748750 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b5268af4-c9e1-4fd6-9246-bd930c228b55 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:25.756760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b5268af4-c9e1-4fd6-9246-bd930c228b55 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084062 May 24 13:24:25.757317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 739/1471] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:25 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:26.774170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-93a44c12-c976-4d47-8537-5fb54a09bf52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:26.774775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-93a44c12-c976-4d47-8537-5fb54a09bf52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:26.781213 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93a44c12-c976-4d47-8537-5fb54a09bf52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:26.782302 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93a44c12-c976-4d47-8537-5fb54a09bf52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:26.783061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93a44c12-c976-4d47-8537-5fb54a09bf52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:26.783496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93a44c12-c976-4d47-8537-5fb54a09bf52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:26.842659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-93a44c12-c976-4d47-8537-5fb54a09bf52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:26.850776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-93a44c12-c976-4d47-8537-5fb54a09bf52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080529 May 24 13:24:26.851333 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 733/1472] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:26 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:27.867942 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-880191d5-eb69-4852-98f3-576ef653e58e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:27.868559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-880191d5-eb69-4852-98f3-576ef653e58e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:27.875590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-880191d5-eb69-4852-98f3-576ef653e58e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:27.876071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-880191d5-eb69-4852-98f3-576ef653e58e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:27.876829 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-880191d5-eb69-4852-98f3-576ef653e58e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:27.877264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-880191d5-eb69-4852-98f3-576ef653e58e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:27.939241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-880191d5-eb69-4852-98f3-576ef653e58e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:27.946700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-880191d5-eb69-4852-98f3-576ef653e58e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082650 May 24 13:24:27.947266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 740/1473] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:27 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:28.964326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-afc06024-b619-4726-81a4-dc8e6a61427f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:28.964882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-afc06024-b619-4726-81a4-dc8e6a61427f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:28.971409 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afc06024-b619-4726-81a4-dc8e6a61427f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:28.971858 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afc06024-b619-4726-81a4-dc8e6a61427f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:28.972615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afc06024-b619-4726-81a4-dc8e6a61427f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:28.973050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afc06024-b619-4726-81a4-dc8e6a61427f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:29.040137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-afc06024-b619-4726-81a4-dc8e6a61427f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:29.048096 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-afc06024-b619-4726-81a4-dc8e6a61427f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.087697 May 24 13:24:29.048654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 734/1474] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:28 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:30.064809 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b5be75cc-561d-487b-b520-1e447eed10fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:30.065420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b5be75cc-561d-487b-b520-1e447eed10fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:30.071990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5be75cc-561d-487b-b520-1e447eed10fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:30.072434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5be75cc-561d-487b-b520-1e447eed10fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:30.073183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5be75cc-561d-487b-b520-1e447eed10fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:30.073614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b5be75cc-561d-487b-b520-1e447eed10fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:30.135157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b5be75cc-561d-487b-b520-1e447eed10fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:30.142966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b5be75cc-561d-487b-b520-1e447eed10fb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081930 May 24 13:24:30.143712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 741/1475] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:30 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:31.160343 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-471b8c4b-fd83-4d34-96fc-09d9816b17f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:31.160963 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-471b8c4b-fd83-4d34-96fc-09d9816b17f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:31.167492 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-471b8c4b-fd83-4d34-96fc-09d9816b17f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:31.167940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-471b8c4b-fd83-4d34-96fc-09d9816b17f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:31.168695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-471b8c4b-fd83-4d34-96fc-09d9816b17f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:31.169125 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-471b8c4b-fd83-4d34-96fc-09d9816b17f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:31.230654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-471b8c4b-fd83-4d34-96fc-09d9816b17f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:31.238261 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-471b8c4b-fd83-4d34-96fc-09d9816b17f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082345 May 24 13:24:31.238858 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 735/1476] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:31 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:32.255549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-050a7cc3-b359-496a-a03b-d63ec807d79a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:32.256169 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-050a7cc3-b359-496a-a03b-d63ec807d79a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:32.262698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-050a7cc3-b359-496a-a03b-d63ec807d79a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:32.263141 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-050a7cc3-b359-496a-a03b-d63ec807d79a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:32.263897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-050a7cc3-b359-496a-a03b-d63ec807d79a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:32.264329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-050a7cc3-b359-496a-a03b-d63ec807d79a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:32.324147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-050a7cc3-b359-496a-a03b-d63ec807d79a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:32.332258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-050a7cc3-b359-496a-a03b-d63ec807d79a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080582 May 24 13:24:32.332823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 742/1477] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:32 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:24:33.349498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-571a1e06-948e-42f9-839b-10af3e58d3ad tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:33.350113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-571a1e06-948e-42f9-839b-10af3e58d3ad tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:33.356657 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-571a1e06-948e-42f9-839b-10af3e58d3ad tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:33.357121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-571a1e06-948e-42f9-839b-10af3e58d3ad tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:33.357861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-571a1e06-948e-42f9-839b-10af3e58d3ad tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:33.358564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-571a1e06-948e-42f9-839b-10af3e58d3ad tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:33.421797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-571a1e06-948e-42f9-839b-10af3e58d3ad tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:33.429410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-571a1e06-948e-42f9-839b-10af3e58d3ad tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083731 May 24 13:24:33.429976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 736/1478] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:33 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:34.446266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bc37e268-b8c6-4908-b896-e46c6f651a3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:34.446910 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bc37e268-b8c6-4908-b896-e46c6f651a3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:34.449240 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=28 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:24:34.455479 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc37e268-b8c6-4908-b896-e46c6f651a3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:34.455929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc37e268-b8c6-4908-b896-e46c6f651a3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:34.456688 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc37e268-b8c6-4908-b896-e46c6f651a3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:34.457125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc37e268-b8c6-4908-b896-e46c6f651a3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:34.516956 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bc37e268-b8c6-4908-b896-e46c6f651a3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:34.524411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bc37e268-b8c6-4908-b896-e46c6f651a3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082059 May 24 13:24:34.524974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 743/1479] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:34 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:35.540876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2f9c08db-53e6-4b18-a281-81a3d0932669 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:35.541482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2f9c08db-53e6-4b18-a281-81a3d0932669 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:35.543789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=28 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:24:35.550457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f9c08db-53e6-4b18-a281-81a3d0932669 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:35.550909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f9c08db-53e6-4b18-a281-81a3d0932669 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:35.551666 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f9c08db-53e6-4b18-a281-81a3d0932669 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:35.552095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f9c08db-53e6-4b18-a281-81a3d0932669 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:35.611859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2f9c08db-53e6-4b18-a281-81a3d0932669 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:35.619205 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2f9c08db-53e6-4b18-a281-81a3d0932669 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082224 May 24 13:24:35.619765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 737/1480] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:35 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:36.636032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6801d526-65d4-4431-ae39-0405582b2e37 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:36.636644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6801d526-65d4-4431-ae39-0405582b2e37 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:36.643865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6801d526-65d4-4431-ae39-0405582b2e37 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:36.644322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6801d526-65d4-4431-ae39-0405582b2e37 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:36.645126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6801d526-65d4-4431-ae39-0405582b2e37 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:36.645577 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6801d526-65d4-4431-ae39-0405582b2e37 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:36.708713 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6801d526-65d4-4431-ae39-0405582b2e37 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:36.716206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6801d526-65d4-4431-ae39-0405582b2e37 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084168 May 24 13:24:36.716806 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 744/1481] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:36 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:37.733001 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3636f857-84cb-4026-8741-e7cb28111d9d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:37.733851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3636f857-84cb-4026-8741-e7cb28111d9d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:37.744825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3636f857-84cb-4026-8741-e7cb28111d9d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:37.745266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3636f857-84cb-4026-8741-e7cb28111d9d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:37.746028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3636f857-84cb-4026-8741-e7cb28111d9d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:37.746529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3636f857-84cb-4026-8741-e7cb28111d9d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:37.808410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3636f857-84cb-4026-8741-e7cb28111d9d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:37.815716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3636f857-84cb-4026-8741-e7cb28111d9d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.086569 May 24 13:24:37.816276 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 738/1482] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:37 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:38.833162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8797df98-da6b-4c92-a441-f6a5d2c36015 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:38.833773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8797df98-da6b-4c92-a441-f6a5d2c36015 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:38.840205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8797df98-da6b-4c92-a441-f6a5d2c36015 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:38.840652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8797df98-da6b-4c92-a441-f6a5d2c36015 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:38.841406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8797df98-da6b-4c92-a441-f6a5d2c36015 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:38.841837 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8797df98-da6b-4c92-a441-f6a5d2c36015 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:38.901358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8797df98-da6b-4c92-a441-f6a5d2c36015 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:38.909322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8797df98-da6b-4c92-a441-f6a5d2c36015 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080094 May 24 13:24:38.909886 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 745/1483] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:38 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:39.926583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-87841ef4-162b-4445-b67d-0dd7ff8cf7f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:39.927207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-87841ef4-162b-4445-b67d-0dd7ff8cf7f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:39.933789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87841ef4-162b-4445-b67d-0dd7ff8cf7f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:39.934236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87841ef4-162b-4445-b67d-0dd7ff8cf7f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:39.935030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87841ef4-162b-4445-b67d-0dd7ff8cf7f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:39.935464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87841ef4-162b-4445-b67d-0dd7ff8cf7f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:39.994900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-87841ef4-162b-4445-b67d-0dd7ff8cf7f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:40.002409 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-87841ef4-162b-4445-b67d-0dd7ff8cf7f4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079656 May 24 13:24:40.002972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 739/1484] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:39 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:41.019759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9a8b9ce0-1f20-4c54-8306-8f967120427c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:41.020381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9a8b9ce0-1f20-4c54-8306-8f967120427c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:41.027004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9a8b9ce0-1f20-4c54-8306-8f967120427c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:41.027454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9a8b9ce0-1f20-4c54-8306-8f967120427c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:41.028219 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9a8b9ce0-1f20-4c54-8306-8f967120427c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:41.028656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9a8b9ce0-1f20-4c54-8306-8f967120427c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:41.089032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9a8b9ce0-1f20-4c54-8306-8f967120427c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:41.097331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9a8b9ce0-1f20-4c54-8306-8f967120427c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081928 May 24 13:24:41.097892 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 746/1485] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:41 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:24:42.115012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-846abfb1-b6bb-408b-8a69-8d9939365214 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:42.115615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-846abfb1-b6bb-408b-8a69-8d9939365214 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:42.122083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-846abfb1-b6bb-408b-8a69-8d9939365214 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:42.122563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-846abfb1-b6bb-408b-8a69-8d9939365214 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:42.123317 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-846abfb1-b6bb-408b-8a69-8d9939365214 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:42.123750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-846abfb1-b6bb-408b-8a69-8d9939365214 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:42.182862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-846abfb1-b6bb-408b-8a69-8d9939365214 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:42.190249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-846abfb1-b6bb-408b-8a69-8d9939365214 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079134 May 24 13:24:42.190833 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 740/1486] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:42 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:43.207576 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-310d6d4e-138d-4836-a2e5-1617e5815ae5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:43.208126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-310d6d4e-138d-4836-a2e5-1617e5815ae5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:43.214709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-310d6d4e-138d-4836-a2e5-1617e5815ae5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:43.215165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-310d6d4e-138d-4836-a2e5-1617e5815ae5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:43.215942 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-310d6d4e-138d-4836-a2e5-1617e5815ae5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:43.216385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-310d6d4e-138d-4836-a2e5-1617e5815ae5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:43.278043 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-310d6d4e-138d-4836-a2e5-1617e5815ae5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:43.286039 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-310d6d4e-138d-4836-a2e5-1617e5815ae5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082957 May 24 13:24:43.286653 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 747/1487] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:43 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:44.307487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-146e7c47-8258-4311-a2a0-f677962d0255 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:44.308183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-146e7c47-8258-4311-a2a0-f677962d0255 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:44.315789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-146e7c47-8258-4311-a2a0-f677962d0255 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:44.316245 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-146e7c47-8258-4311-a2a0-f677962d0255 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:44.317141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-146e7c47-8258-4311-a2a0-f677962d0255 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:44.317643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-146e7c47-8258-4311-a2a0-f677962d0255 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:44.378101 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-146e7c47-8258-4311-a2a0-f677962d0255 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:44.385631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-146e7c47-8258-4311-a2a0-f677962d0255 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082558 May 24 13:24:44.386203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 741/1488] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:44 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:45.402654 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2c2678c6-fa18-4e74-a1d9-6ed440761c30 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:45.403275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2c2678c6-fa18-4e74-a1d9-6ed440761c30 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:45.410511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c2678c6-fa18-4e74-a1d9-6ed440761c30 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:45.410976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c2678c6-fa18-4e74-a1d9-6ed440761c30 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:45.411917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c2678c6-fa18-4e74-a1d9-6ed440761c30 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:45.412365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c2678c6-fa18-4e74-a1d9-6ed440761c30 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:45.474887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2c2678c6-fa18-4e74-a1d9-6ed440761c30 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:45.482590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2c2678c6-fa18-4e74-a1d9-6ed440761c30 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083886 May 24 13:24:45.483418 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 748/1489] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:45 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:46.500992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e924378-b69d-4642-a435-5b69c20aab81 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:46.501605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e924378-b69d-4642-a435-5b69c20aab81 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:46.508066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e924378-b69d-4642-a435-5b69c20aab81 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:46.508508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e924378-b69d-4642-a435-5b69c20aab81 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:46.509258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e924378-b69d-4642-a435-5b69c20aab81 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:46.509686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e924378-b69d-4642-a435-5b69c20aab81 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:46.572840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e924378-b69d-4642-a435-5b69c20aab81 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:46.581000 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e924378-b69d-4642-a435-5b69c20aab81 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084670 May 24 13:24:46.581567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 742/1490] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:46 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:47.597689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ebdc275a-b281-49e2-9601-9f57f3489b84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:47.598316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ebdc275a-b281-49e2-9601-9f57f3489b84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:47.604548 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebdc275a-b281-49e2-9601-9f57f3489b84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:47.604993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebdc275a-b281-49e2-9601-9f57f3489b84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:47.605749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebdc275a-b281-49e2-9601-9f57f3489b84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:47.606182 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebdc275a-b281-49e2-9601-9f57f3489b84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:47.609530 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=82 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:24:47.666266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ebdc275a-b281-49e2-9601-9f57f3489b84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:47.674087 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ebdc275a-b281-49e2-9601-9f57f3489b84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080272 May 24 13:24:47.674678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 749/1491] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:47 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:48.691624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e36493fc-1ecb-45b2-bdfb-944b03d55416 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:48.692238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e36493fc-1ecb-45b2-bdfb-944b03d55416 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:48.698376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e36493fc-1ecb-45b2-bdfb-944b03d55416 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:48.698830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e36493fc-1ecb-45b2-bdfb-944b03d55416 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:48.699593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e36493fc-1ecb-45b2-bdfb-944b03d55416 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:48.700029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e36493fc-1ecb-45b2-bdfb-944b03d55416 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:48.760601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e36493fc-1ecb-45b2-bdfb-944b03d55416 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:48.768827 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e36493fc-1ecb-45b2-bdfb-944b03d55416 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081721 May 24 13:24:48.769428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 743/1492] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:48 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:49.785937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e3b56abe-2f87-49b8-9ab2-e2f4889a9b74 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:49.786527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e3b56abe-2f87-49b8-9ab2-e2f4889a9b74 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:49.793117 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e3b56abe-2f87-49b8-9ab2-e2f4889a9b74 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:49.793574 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e3b56abe-2f87-49b8-9ab2-e2f4889a9b74 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:49.794363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e3b56abe-2f87-49b8-9ab2-e2f4889a9b74 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:49.794815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e3b56abe-2f87-49b8-9ab2-e2f4889a9b74 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:49.855613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e3b56abe-2f87-49b8-9ab2-e2f4889a9b74 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:49.863888 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e3b56abe-2f87-49b8-9ab2-e2f4889a9b74 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081918 May 24 13:24:49.864454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 750/1493] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:49 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:50.881281 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d4b7d136-7e6d-4186-9bcd-35e45a10abfb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:50.881885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d4b7d136-7e6d-4186-9bcd-35e45a10abfb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:50.888321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d4b7d136-7e6d-4186-9bcd-35e45a10abfb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:50.888770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d4b7d136-7e6d-4186-9bcd-35e45a10abfb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:50.889519 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d4b7d136-7e6d-4186-9bcd-35e45a10abfb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:50.889947 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d4b7d136-7e6d-4186-9bcd-35e45a10abfb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:50.950825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d4b7d136-7e6d-4186-9bcd-35e45a10abfb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:50.958107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d4b7d136-7e6d-4186-9bcd-35e45a10abfb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080720 May 24 13:24:50.958767 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 744/1494] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:50 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:51.974903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-97dc52d2-86c4-4563-9bab-99ed7c29140c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:51.975517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-97dc52d2-86c4-4563-9bab-99ed7c29140c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:51.981945 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97dc52d2-86c4-4563-9bab-99ed7c29140c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:51.982417 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97dc52d2-86c4-4563-9bab-99ed7c29140c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:51.983444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97dc52d2-86c4-4563-9bab-99ed7c29140c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:51.983873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97dc52d2-86c4-4563-9bab-99ed7c29140c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:52.043155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-97dc52d2-86c4-4563-9bab-99ed7c29140c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:52.050981 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-97dc52d2-86c4-4563-9bab-99ed7c29140c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079947 May 24 13:24:52.051537 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 751/1495] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:51 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:53.067816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ff4ab903-b76b-4ae9-a9f3-6c9db294ae80 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:53.068412 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ff4ab903-b76b-4ae9-a9f3-6c9db294ae80 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:53.074980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff4ab903-b76b-4ae9-a9f3-6c9db294ae80 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:53.075428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff4ab903-b76b-4ae9-a9f3-6c9db294ae80 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:53.076190 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff4ab903-b76b-4ae9-a9f3-6c9db294ae80 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:53.076632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff4ab903-b76b-4ae9-a9f3-6c9db294ae80 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:53.079147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=84 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:24:53.138606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff4ab903-b76b-4ae9-a9f3-6c9db294ae80 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:53.146003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ff4ab903-b76b-4ae9-a9f3-6c9db294ae80 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082002 May 24 13:24:53.146597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 745/1496] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:53 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:54.163181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4880da65-fdd9-48bd-929f-45b2187961f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:54.163795 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4880da65-fdd9-48bd-929f-45b2187961f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:54.170230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4880da65-fdd9-48bd-929f-45b2187961f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:54.170712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4880da65-fdd9-48bd-929f-45b2187961f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:54.172073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4880da65-fdd9-48bd-929f-45b2187961f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:54.172503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4880da65-fdd9-48bd-929f-45b2187961f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:54.234742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-4880da65-fdd9-48bd-929f-45b2187961f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:54.242262 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4880da65-fdd9-48bd-929f-45b2187961f2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082967 May 24 13:24:54.242854 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 752/1497] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:54 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:54.674649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3ea49f41-be6e-472a-8e3b-a3430d178ed6 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:54.675198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3ea49f41-be6e-472a-8e3b-a3430d178ed6 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:54.681640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ea49f41-be6e-472a-8e3b-a3430d178ed6 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:54.682085 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ea49f41-be6e-472a-8e3b-a3430d178ed6 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:54.682879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ea49f41-be6e-472a-8e3b-a3430d178ed6 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:54.683306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ea49f41-be6e-472a-8e3b-a3430d178ed6 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:54.706481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3ea49f41-be6e-472a-8e3b-a3430d178ed6 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5/ips" status: 200 len: 150 microversion: 2.1 time: 0.036037 May 24 13:24:54.707022 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 746/1498] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 13:24:54 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:24:55.259168 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e742c127-8123-4f6b-990a-0eefd2183a77 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:55.259788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e742c127-8123-4f6b-990a-0eefd2183a77 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:55.266768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e742c127-8123-4f6b-990a-0eefd2183a77 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:55.267220 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e742c127-8123-4f6b-990a-0eefd2183a77 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:55.267983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e742c127-8123-4f6b-990a-0eefd2183a77 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:55.268422 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e742c127-8123-4f6b-990a-0eefd2183a77 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:55.329787 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e742c127-8123-4f6b-990a-0eefd2183a77 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:55.337590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e742c127-8123-4f6b-990a-0eefd2183a77 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082279 May 24 13:24:55.338159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 753/1499] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:55 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:56.355021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ac0f60ef-f8f8-4a1d-807e-28a31e31e2a8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:56.355627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ac0f60ef-f8f8-4a1d-807e-28a31e31e2a8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:56.362405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac0f60ef-f8f8-4a1d-807e-28a31e31e2a8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:56.362850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac0f60ef-f8f8-4a1d-807e-28a31e31e2a8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:56.363596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac0f60ef-f8f8-4a1d-807e-28a31e31e2a8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:56.364020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac0f60ef-f8f8-4a1d-807e-28a31e31e2a8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:56.427286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ac0f60ef-f8f8-4a1d-807e-28a31e31e2a8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:56.434754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ac0f60ef-f8f8-4a1d-807e-28a31e31e2a8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083622 May 24 13:24:56.435310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 747/1500] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:56 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:57.450989 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1ec9a7ff-00a2-448e-8b0b-4111b621493d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:57.451611 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1ec9a7ff-00a2-448e-8b0b-4111b621493d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:57.458185 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ec9a7ff-00a2-448e-8b0b-4111b621493d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:57.458666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ec9a7ff-00a2-448e-8b0b-4111b621493d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:57.459425 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ec9a7ff-00a2-448e-8b0b-4111b621493d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:57.459863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ec9a7ff-00a2-448e-8b0b-4111b621493d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:57.519293 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1ec9a7ff-00a2-448e-8b0b-4111b621493d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:57.526724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1ec9a7ff-00a2-448e-8b0b-4111b621493d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079584 May 24 13:24:57.527290 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 754/1501] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:57 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:58.542848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a9e2a428-476c-4cd7-afcc-3643ba9e18e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:58.543396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a9e2a428-476c-4cd7-afcc-3643ba9e18e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:58.550503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9e2a428-476c-4cd7-afcc-3643ba9e18e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:58.550982 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9e2a428-476c-4cd7-afcc-3643ba9e18e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:58.551740 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9e2a428-476c-4cd7-afcc-3643ba9e18e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:58.552178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9e2a428-476c-4cd7-afcc-3643ba9e18e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:58.611429 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a9e2a428-476c-4cd7-afcc-3643ba9e18e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:58.618875 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a9e2a428-476c-4cd7-afcc-3643ba9e18e6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079972 May 24 13:24:58.619431 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 748/1502] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:58 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:24:59.635656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6828767c-2714-4a3e-927c-dca873273e86 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:24:59.636269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6828767c-2714-4a3e-927c-dca873273e86 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:24:59.642876 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6828767c-2714-4a3e-927c-dca873273e86 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:59.643328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6828767c-2714-4a3e-927c-dca873273e86 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:59.644081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6828767c-2714-4a3e-927c-dca873273e86 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:24:59.644511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6828767c-2714-4a3e-927c-dca873273e86 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:24:59.705404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6828767c-2714-4a3e-927c-dca873273e86 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:24:59.712839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6828767c-2714-4a3e-927c-dca873273e86 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081069 May 24 13:24:59.713391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 755/1503] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:24:59 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:00.730161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9c2307c1-cb05-495a-94f1-31604aa70baf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:00.730728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9c2307c1-cb05-495a-94f1-31604aa70baf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:00.738036 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c2307c1-cb05-495a-94f1-31604aa70baf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:00.738520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c2307c1-cb05-495a-94f1-31604aa70baf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:00.739284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c2307c1-cb05-495a-94f1-31604aa70baf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:00.739720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c2307c1-cb05-495a-94f1-31604aa70baf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:00.800987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9c2307c1-cb05-495a-94f1-31604aa70baf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:00.808477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9c2307c1-cb05-495a-94f1-31604aa70baf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082239 May 24 13:25:00.809037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 749/1504] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:00 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:01.825157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-82cf7137-8975-40c8-aeab-43b5c561ab2f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:01.825779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-82cf7137-8975-40c8-aeab-43b5c561ab2f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:01.833247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-82cf7137-8975-40c8-aeab-43b5c561ab2f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:01.833694 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-82cf7137-8975-40c8-aeab-43b5c561ab2f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:01.834526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-82cf7137-8975-40c8-aeab-43b5c561ab2f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:01.834969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-82cf7137-8975-40c8-aeab-43b5c561ab2f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:01.898124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-82cf7137-8975-40c8-aeab-43b5c561ab2f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:01.905616 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-82cf7137-8975-40c8-aeab-43b5c561ab2f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084317 May 24 13:25:01.906183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 756/1505] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:01 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:02.923291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8dd4aa18-5307-46ca-a427-09a40f0fc196 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:02.923906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8dd4aa18-5307-46ca-a427-09a40f0fc196 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:02.930215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dd4aa18-5307-46ca-a427-09a40f0fc196 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:02.930689 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dd4aa18-5307-46ca-a427-09a40f0fc196 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:02.931452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dd4aa18-5307-46ca-a427-09a40f0fc196 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:02.931881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dd4aa18-5307-46ca-a427-09a40f0fc196 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:02.992380 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8dd4aa18-5307-46ca-a427-09a40f0fc196 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:02.999136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8dd4aa18-5307-46ca-a427-09a40f0fc196 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080353 May 24 13:25:02.999690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 750/1506] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:02 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:04.016737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a6eb73a3-87fa-483e-860f-1bf0ac7eee8c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:04.017362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a6eb73a3-87fa-483e-860f-1bf0ac7eee8c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:04.023944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6eb73a3-87fa-483e-860f-1bf0ac7eee8c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:04.024401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6eb73a3-87fa-483e-860f-1bf0ac7eee8c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:04.025174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6eb73a3-87fa-483e-860f-1bf0ac7eee8c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:04.025627 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6eb73a3-87fa-483e-860f-1bf0ac7eee8c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:04.085922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a6eb73a3-87fa-483e-860f-1bf0ac7eee8c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:04.093562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a6eb73a3-87fa-483e-860f-1bf0ac7eee8c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081337 May 24 13:25:04.094126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 757/1507] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:04 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:05.110329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7dbf3369-6751-4a86-8dd5-79cacebd7070 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:05.111253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7dbf3369-6751-4a86-8dd5-79cacebd7070 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:05.117877 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7dbf3369-6751-4a86-8dd5-79cacebd7070 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:05.118371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7dbf3369-6751-4a86-8dd5-79cacebd7070 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:05.119138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7dbf3369-6751-4a86-8dd5-79cacebd7070 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:05.119586 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7dbf3369-6751-4a86-8dd5-79cacebd7070 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:05.182474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7dbf3369-6751-4a86-8dd5-79cacebd7070 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:05.190684 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7dbf3369-6751-4a86-8dd5-79cacebd7070 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084473 May 24 13:25:05.191251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 751/1508] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:05 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:06.207568 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9214e84b-3499-4e3b-be93-c19603a92895 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:06.208191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9214e84b-3499-4e3b-be93-c19603a92895 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:06.210590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:25:06.215921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9214e84b-3499-4e3b-be93-c19603a92895 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:06.216375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9214e84b-3499-4e3b-be93-c19603a92895 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:06.217140 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9214e84b-3499-4e3b-be93-c19603a92895 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:06.217585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9214e84b-3499-4e3b-be93-c19603a92895 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:06.277113 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9214e84b-3499-4e3b-be93-c19603a92895 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:06.285301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9214e84b-3499-4e3b-be93-c19603a92895 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081300 May 24 13:25:06.285536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 758/1509] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:06 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:07.301814 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-57117bf2-1207-44a1-92fc-f4827ee0c6d1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:07.302451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-57117bf2-1207-44a1-92fc-f4827ee0c6d1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:07.304748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:25:07.310067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57117bf2-1207-44a1-92fc-f4827ee0c6d1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:07.310541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57117bf2-1207-44a1-92fc-f4827ee0c6d1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:07.311301 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57117bf2-1207-44a1-92fc-f4827ee0c6d1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:07.311729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57117bf2-1207-44a1-92fc-f4827ee0c6d1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:07.371242 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57117bf2-1207-44a1-92fc-f4827ee0c6d1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:07.378725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-57117bf2-1207-44a1-92fc-f4827ee0c6d1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080779 May 24 13:25:07.379285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 752/1510] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:07 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:08.396061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2545c8bc-cbcd-4062-8349-b04fede6592b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:08.396676 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2545c8bc-cbcd-4062-8349-b04fede6592b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:08.403292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2545c8bc-cbcd-4062-8349-b04fede6592b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:08.403737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2545c8bc-cbcd-4062-8349-b04fede6592b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:08.404495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2545c8bc-cbcd-4062-8349-b04fede6592b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:08.404954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2545c8bc-cbcd-4062-8349-b04fede6592b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:08.465640 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2545c8bc-cbcd-4062-8349-b04fede6592b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:08.473126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2545c8bc-cbcd-4062-8349-b04fede6592b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080948 May 24 13:25:08.473684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 759/1511] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:08 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:09.489143 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-584d2bcd-60ab-4495-8765-a55373969298 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:09.489766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-584d2bcd-60ab-4495-8765-a55373969298 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:09.496304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-584d2bcd-60ab-4495-8765-a55373969298 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:09.496756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-584d2bcd-60ab-4495-8765-a55373969298 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:09.497519 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-584d2bcd-60ab-4495-8765-a55373969298 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:09.497958 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-584d2bcd-60ab-4495-8765-a55373969298 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:09.557479 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-584d2bcd-60ab-4495-8765-a55373969298 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:09.565037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-584d2bcd-60ab-4495-8765-a55373969298 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079794 May 24 13:25:09.565602 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 753/1512] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:09 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:10.582083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-21f067c0-aaa5-44ec-9ac6-8706f27c2ecc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:10.582729 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-21f067c0-aaa5-44ec-9ac6-8706f27c2ecc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:10.589268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-21f067c0-aaa5-44ec-9ac6-8706f27c2ecc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:10.589696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-21f067c0-aaa5-44ec-9ac6-8706f27c2ecc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:10.590489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-21f067c0-aaa5-44ec-9ac6-8706f27c2ecc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:10.590926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-21f067c0-aaa5-44ec-9ac6-8706f27c2ecc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:10.665094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-21f067c0-aaa5-44ec-9ac6-8706f27c2ecc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:10.673751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-21f067c0-aaa5-44ec-9ac6-8706f27c2ecc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.095455 May 24 13:25:10.674704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 760/1513] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:10 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:11.691014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-374bc818-7e3c-49f7-90b3-448caf3eff9a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:11.691590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-374bc818-7e3c-49f7-90b3-448caf3eff9a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:11.698250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374bc818-7e3c-49f7-90b3-448caf3eff9a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:11.698726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374bc818-7e3c-49f7-90b3-448caf3eff9a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:11.699489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374bc818-7e3c-49f7-90b3-448caf3eff9a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:11.699920 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374bc818-7e3c-49f7-90b3-448caf3eff9a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:11.759220 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-374bc818-7e3c-49f7-90b3-448caf3eff9a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:11.766667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-374bc818-7e3c-49f7-90b3-448caf3eff9a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080210 May 24 13:25:11.767237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 754/1514] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:11 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:12.783421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-de50393f-7533-4872-8e1d-a68321751e9f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:12.784078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-de50393f-7533-4872-8e1d-a68321751e9f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:12.790608 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de50393f-7533-4872-8e1d-a68321751e9f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:12.791061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de50393f-7533-4872-8e1d-a68321751e9f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:12.791819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de50393f-7533-4872-8e1d-a68321751e9f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:12.792255 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de50393f-7533-4872-8e1d-a68321751e9f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:12.853148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-de50393f-7533-4872-8e1d-a68321751e9f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:12.861029 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-de50393f-7533-4872-8e1d-a68321751e9f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081484 May 24 13:25:12.861601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 761/1515] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:12 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:13.877492 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-53b964ab-1c35-4d3c-8440-41352ad2d37f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:13.878125 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-53b964ab-1c35-4d3c-8440-41352ad2d37f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:13.884564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-53b964ab-1c35-4d3c-8440-41352ad2d37f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:13.885006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-53b964ab-1c35-4d3c-8440-41352ad2d37f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:13.885754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-53b964ab-1c35-4d3c-8440-41352ad2d37f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:13.886179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-53b964ab-1c35-4d3c-8440-41352ad2d37f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:13.947581 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-53b964ab-1c35-4d3c-8440-41352ad2d37f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:13.955458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-53b964ab-1c35-4d3c-8440-41352ad2d37f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082456 May 24 13:25:13.956014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 755/1516] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:13 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:14.972986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ef2c5094-242e-41bb-b9fb-0223facee345 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:14.973630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ef2c5094-242e-41bb-b9fb-0223facee345 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:14.980099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ef2c5094-242e-41bb-b9fb-0223facee345 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:14.980552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ef2c5094-242e-41bb-b9fb-0223facee345 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:14.981324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ef2c5094-242e-41bb-b9fb-0223facee345 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:14.981769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ef2c5094-242e-41bb-b9fb-0223facee345 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:15.044114 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ef2c5094-242e-41bb-b9fb-0223facee345 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:15.052194 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ef2c5094-242e-41bb-b9fb-0223facee345 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083154 May 24 13:25:15.052753 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 762/1517] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:14 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:25:16.068852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4d8d7fda-a184-4bdb-bc80-bd9e062cff23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:16.069472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4d8d7fda-a184-4bdb-bc80-bd9e062cff23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:16.076132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d8d7fda-a184-4bdb-bc80-bd9e062cff23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:16.076585 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d8d7fda-a184-4bdb-bc80-bd9e062cff23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:16.077350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d8d7fda-a184-4bdb-bc80-bd9e062cff23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:16.077789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d8d7fda-a184-4bdb-bc80-bd9e062cff23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:16.139437 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4d8d7fda-a184-4bdb-bc80-bd9e062cff23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:16.147101 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4d8d7fda-a184-4bdb-bc80-bd9e062cff23 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082076 May 24 13:25:16.147659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 756/1518] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:16 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:17.163602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7c1c800b-db5d-4ab9-97ee-2f022a78d2f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:17.164223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7c1c800b-db5d-4ab9-97ee-2f022a78d2f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:17.170467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c1c800b-db5d-4ab9-97ee-2f022a78d2f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:17.170919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c1c800b-db5d-4ab9-97ee-2f022a78d2f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:17.171685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c1c800b-db5d-4ab9-97ee-2f022a78d2f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:17.172126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c1c800b-db5d-4ab9-97ee-2f022a78d2f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:17.231828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7c1c800b-db5d-4ab9-97ee-2f022a78d2f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:17.239472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7c1c800b-db5d-4ab9-97ee-2f022a78d2f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079906 May 24 13:25:17.240045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 763/1519] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:17 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:18.257217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-55700ba1-e823-4f5b-8bdc-cc8d9d075211 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:18.257828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-55700ba1-e823-4f5b-8bdc-cc8d9d075211 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:18.263780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55700ba1-e823-4f5b-8bdc-cc8d9d075211 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:18.264224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55700ba1-e823-4f5b-8bdc-cc8d9d075211 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:18.264980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55700ba1-e823-4f5b-8bdc-cc8d9d075211 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:18.265407 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55700ba1-e823-4f5b-8bdc-cc8d9d075211 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:18.324688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-55700ba1-e823-4f5b-8bdc-cc8d9d075211 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:18.332670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-55700ba1-e823-4f5b-8bdc-cc8d9d075211 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079647 May 24 13:25:18.333228 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 757/1520] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:18 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:19.349565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7895ff16-9a14-4403-80e7-a7d5a6b69293 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:19.350188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7895ff16-9a14-4403-80e7-a7d5a6b69293 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:19.356805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7895ff16-9a14-4403-80e7-a7d5a6b69293 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:19.357259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7895ff16-9a14-4403-80e7-a7d5a6b69293 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:19.358305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7895ff16-9a14-4403-80e7-a7d5a6b69293 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:19.358755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7895ff16-9a14-4403-80e7-a7d5a6b69293 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:19.362648 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:25:19.421227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7895ff16-9a14-4403-80e7-a7d5a6b69293 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:19.429992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7895ff16-9a14-4403-80e7-a7d5a6b69293 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083236 May 24 13:25:19.431014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 764/1521] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:19 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:20.005885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:25:20.006157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:25:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:25:20.447912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d7d8e536-fdcf-41ac-88ac-e250bd6dc6d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:20.448533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d7d8e536-fdcf-41ac-88ac-e250bd6dc6d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:20.456042 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7d8e536-fdcf-41ac-88ac-e250bd6dc6d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:20.456482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7d8e536-fdcf-41ac-88ac-e250bd6dc6d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:20.457233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7d8e536-fdcf-41ac-88ac-e250bd6dc6d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:20.457662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7d8e536-fdcf-41ac-88ac-e250bd6dc6d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:20.520147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d7d8e536-fdcf-41ac-88ac-e250bd6dc6d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:20.527982 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d7d8e536-fdcf-41ac-88ac-e250bd6dc6d6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083993 May 24 13:25:20.528537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 758/1522] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:20 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:21.544877 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-264933c4-960e-40d6-8bf6-840fdb8ae57f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:21.545511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-264933c4-960e-40d6-8bf6-840fdb8ae57f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:21.552004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-264933c4-960e-40d6-8bf6-840fdb8ae57f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:21.552452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-264933c4-960e-40d6-8bf6-840fdb8ae57f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:21.553264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-264933c4-960e-40d6-8bf6-840fdb8ae57f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:21.553701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-264933c4-960e-40d6-8bf6-840fdb8ae57f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:21.614309 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-264933c4-960e-40d6-8bf6-840fdb8ae57f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:21.621751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-264933c4-960e-40d6-8bf6-840fdb8ae57f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080783 May 24 13:25:21.622331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 765/1523] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:21 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:22.638500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-42e3d049-7088-405f-84bc-947e6312eb63 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:22.639708 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-42e3d049-7088-405f-84bc-947e6312eb63 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:22.646150 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42e3d049-7088-405f-84bc-947e6312eb63 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:22.646631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42e3d049-7088-405f-84bc-947e6312eb63 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:22.647389 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42e3d049-7088-405f-84bc-947e6312eb63 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:22.647822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42e3d049-7088-405f-84bc-947e6312eb63 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:22.709197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-42e3d049-7088-405f-84bc-947e6312eb63 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:22.716573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-42e3d049-7088-405f-84bc-947e6312eb63 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081955 May 24 13:25:22.717639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 759/1524] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:22 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:23.733122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-64877b9b-a041-419e-9733-4bf073cc5c54 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:23.733666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-64877b9b-a041-419e-9733-4bf073cc5c54 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:23.740368 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64877b9b-a041-419e-9733-4bf073cc5c54 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:23.740817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64877b9b-a041-419e-9733-4bf073cc5c54 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:23.741585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64877b9b-a041-419e-9733-4bf073cc5c54 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:23.742025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-64877b9b-a041-419e-9733-4bf073cc5c54 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:23.801716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-64877b9b-a041-419e-9733-4bf073cc5c54 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:23.809250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-64877b9b-a041-419e-9733-4bf073cc5c54 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080248 May 24 13:25:23.809816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 766/1525] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:23 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:24.825328 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bfd37b76-e7fc-44d0-9f91-85b0efaef823 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:24.825915 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bfd37b76-e7fc-44d0-9f91-85b0efaef823 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:24.833003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfd37b76-e7fc-44d0-9f91-85b0efaef823 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:24.833450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfd37b76-e7fc-44d0-9f91-85b0efaef823 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:24.834204 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfd37b76-e7fc-44d0-9f91-85b0efaef823 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:24.834667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfd37b76-e7fc-44d0-9f91-85b0efaef823 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:24.838505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=88 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:25:24.895799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bfd37b76-e7fc-44d0-9f91-85b0efaef823 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:24.903351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bfd37b76-e7fc-44d0-9f91-85b0efaef823 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081851 May 24 13:25:24.903921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 760/1526] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:24 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:25:25.921931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-91d6ee14-292d-47c7-9473-6b0d8bbbcb8e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:25.921931 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-91d6ee14-292d-47c7-9473-6b0d8bbbcb8e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:25.931531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-91d6ee14-292d-47c7-9473-6b0d8bbbcb8e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:25.931988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-91d6ee14-292d-47c7-9473-6b0d8bbbcb8e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:25.932778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-91d6ee14-292d-47c7-9473-6b0d8bbbcb8e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:25.933223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-91d6ee14-292d-47c7-9473-6b0d8bbbcb8e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:25.993971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-91d6ee14-292d-47c7-9473-6b0d8bbbcb8e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:26.002196 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-91d6ee14-292d-47c7-9473-6b0d8bbbcb8e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085641 May 24 13:25:26.003089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 767/1527] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:25 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:27.019682 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9edb88f9-dc61-41d9-ba8d-70504221512f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:27.020306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9edb88f9-dc61-41d9-ba8d-70504221512f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:27.026979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9edb88f9-dc61-41d9-ba8d-70504221512f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:27.027535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9edb88f9-dc61-41d9-ba8d-70504221512f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:27.028305 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9edb88f9-dc61-41d9-ba8d-70504221512f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:27.028737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9edb88f9-dc61-41d9-ba8d-70504221512f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:27.089043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9edb88f9-dc61-41d9-ba8d-70504221512f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:27.096479 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9edb88f9-dc61-41d9-ba8d-70504221512f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080769 May 24 13:25:27.097034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 761/1528] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:27 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:28.113284 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a66efe92-b33c-41ca-8c76-3d6daf00964e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:28.113895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a66efe92-b33c-41ca-8c76-3d6daf00964e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:28.120429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a66efe92-b33c-41ca-8c76-3d6daf00964e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:28.120875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a66efe92-b33c-41ca-8c76-3d6daf00964e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:28.121626 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a66efe92-b33c-41ca-8c76-3d6daf00964e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:28.122060 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a66efe92-b33c-41ca-8c76-3d6daf00964e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:28.183797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a66efe92-b33c-41ca-8c76-3d6daf00964e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:28.191709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a66efe92-b33c-41ca-8c76-3d6daf00964e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082304 May 24 13:25:28.192281 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 768/1529] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:28 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:29.208744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-34b60c37-8c8e-4b75-a696-f0ddb1635dbf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:29.209367 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-34b60c37-8c8e-4b75-a696-f0ddb1635dbf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:29.215939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34b60c37-8c8e-4b75-a696-f0ddb1635dbf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:29.216391 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34b60c37-8c8e-4b75-a696-f0ddb1635dbf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:29.217162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34b60c37-8c8e-4b75-a696-f0ddb1635dbf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:29.217601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34b60c37-8c8e-4b75-a696-f0ddb1635dbf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:29.276785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-34b60c37-8c8e-4b75-a696-f0ddb1635dbf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:29.284271 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-34b60c37-8c8e-4b75-a696-f0ddb1635dbf tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079714 May 24 13:25:29.284840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 762/1530] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:29 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:30.301755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-383e6a18-f7e3-43c2-a974-2852861fbb06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:30.302435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-383e6a18-f7e3-43c2-a974-2852861fbb06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:30.308909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-383e6a18-f7e3-43c2-a974-2852861fbb06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:30.309354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-383e6a18-f7e3-43c2-a974-2852861fbb06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:30.310108 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-383e6a18-f7e3-43c2-a974-2852861fbb06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:30.310571 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-383e6a18-f7e3-43c2-a974-2852861fbb06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:30.372062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-383e6a18-f7e3-43c2-a974-2852861fbb06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:30.379520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-383e6a18-f7e3-43c2-a974-2852861fbb06 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081652 May 24 13:25:30.380074 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 769/1531] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:30 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:31.397972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-884833c6-4d7b-41e4-b698-b51e9c740987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:31.398619 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-884833c6-4d7b-41e4-b698-b51e9c740987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:31.405739 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-884833c6-4d7b-41e4-b698-b51e9c740987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:31.406198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-884833c6-4d7b-41e4-b698-b51e9c740987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:31.407337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-884833c6-4d7b-41e4-b698-b51e9c740987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:31.407478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-884833c6-4d7b-41e4-b698-b51e9c740987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:31.472304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-884833c6-4d7b-41e4-b698-b51e9c740987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:31.479812 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-884833c6-4d7b-41e4-b698-b51e9c740987 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.086024 May 24 13:25:31.480379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 763/1532] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:31 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:32.496903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a0ff80a0-1c1e-4a00-9e70-f7364d175a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:32.497522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a0ff80a0-1c1e-4a00-9e70-f7364d175a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:32.504555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0ff80a0-1c1e-4a00-9e70-f7364d175a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:32.505004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0ff80a0-1c1e-4a00-9e70-f7364d175a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:32.505767 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0ff80a0-1c1e-4a00-9e70-f7364d175a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:32.506205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0ff80a0-1c1e-4a00-9e70-f7364d175a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:32.565913 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a0ff80a0-1c1e-4a00-9e70-f7364d175a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:32.573428 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a0ff80a0-1c1e-4a00-9e70-f7364d175a87 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080406 May 24 13:25:32.573989 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 770/1533] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:32 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:33.590580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d0be762b-d304-424a-814b-1d2440b2cd13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:33.591202 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d0be762b-d304-424a-814b-1d2440b2cd13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:33.597732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0be762b-d304-424a-814b-1d2440b2cd13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:33.598185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0be762b-d304-424a-814b-1d2440b2cd13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:33.598989 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0be762b-d304-424a-814b-1d2440b2cd13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:33.599425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0be762b-d304-424a-814b-1d2440b2cd13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:33.661728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d0be762b-d304-424a-814b-1d2440b2cd13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:33.669331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d0be762b-d304-424a-814b-1d2440b2cd13 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082690 May 24 13:25:33.670521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 764/1534] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:33 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:34.687393 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8431384a-3316-4ecb-8403-304f336f0a7a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:34.687973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8431384a-3316-4ecb-8403-304f336f0a7a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:34.694496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8431384a-3316-4ecb-8403-304f336f0a7a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:34.694945 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8431384a-3316-4ecb-8403-304f336f0a7a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:34.695703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8431384a-3316-4ecb-8403-304f336f0a7a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:34.696141 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8431384a-3316-4ecb-8403-304f336f0a7a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:34.755379 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8431384a-3316-4ecb-8403-304f336f0a7a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:34.762779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8431384a-3316-4ecb-8403-304f336f0a7a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079831 May 24 13:25:34.763341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 771/1535] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:34 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:35.780175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8016b8dc-fef3-40da-8a50-f8897908f151 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:35.780723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8016b8dc-fef3-40da-8a50-f8897908f151 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:35.787156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8016b8dc-fef3-40da-8a50-f8897908f151 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:35.787608 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8016b8dc-fef3-40da-8a50-f8897908f151 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:35.788366 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8016b8dc-fef3-40da-8a50-f8897908f151 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:35.788800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8016b8dc-fef3-40da-8a50-f8897908f151 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:35.847933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8016b8dc-fef3-40da-8a50-f8897908f151 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:35.855333 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8016b8dc-fef3-40da-8a50-f8897908f151 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079113 May 24 13:25:35.855894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 765/1536] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:35 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:36.873190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ea922e63-caf1-4c0c-b2eb-60e53b9e38d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:36.873810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ea922e63-caf1-4c0c-b2eb-60e53b9e38d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:36.876110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=28 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:25:36.881469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea922e63-caf1-4c0c-b2eb-60e53b9e38d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:36.881919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea922e63-caf1-4c0c-b2eb-60e53b9e38d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:36.882704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea922e63-caf1-4c0c-b2eb-60e53b9e38d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:36.883142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea922e63-caf1-4c0c-b2eb-60e53b9e38d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:36.945193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ea922e63-caf1-4c0c-b2eb-60e53b9e38d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:36.952719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ea922e63-caf1-4c0c-b2eb-60e53b9e38d4 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083467 May 24 13:25:36.953283 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 772/1537] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:36 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:37.971051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-72738a2a-f64b-4a94-9247-1f42358597b0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:37.972200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-72738a2a-f64b-4a94-9247-1f42358597b0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:37.975556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=28 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:25:37.981189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72738a2a-f64b-4a94-9247-1f42358597b0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:37.981640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72738a2a-f64b-4a94-9247-1f42358597b0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:37.982702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72738a2a-f64b-4a94-9247-1f42358597b0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:37.983146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72738a2a-f64b-4a94-9247-1f42358597b0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:38.046847 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-72738a2a-f64b-4a94-9247-1f42358597b0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:38.054590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-72738a2a-f64b-4a94-9247-1f42358597b0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.088865 May 24 13:25:38.055166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 766/1538] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:37 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:39.071002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-aae3a22d-9376-4a50-93e1-a1a6d549793e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:39.071623 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-aae3a22d-9376-4a50-93e1-a1a6d549793e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:39.078129 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aae3a22d-9376-4a50-93e1-a1a6d549793e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:39.078625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aae3a22d-9376-4a50-93e1-a1a6d549793e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:39.079385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aae3a22d-9376-4a50-93e1-a1a6d549793e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:39.079822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aae3a22d-9376-4a50-93e1-a1a6d549793e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:39.139651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-aae3a22d-9376-4a50-93e1-a1a6d549793e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:39.147085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-aae3a22d-9376-4a50-93e1-a1a6d549793e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079994 May 24 13:25:39.147647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 773/1539] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:39 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:40.163981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d735905a-55eb-45e7-a90a-7fa886be1323 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:40.164577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d735905a-55eb-45e7-a90a-7fa886be1323 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:40.171553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d735905a-55eb-45e7-a90a-7fa886be1323 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:40.171999 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d735905a-55eb-45e7-a90a-7fa886be1323 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:40.172757 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d735905a-55eb-45e7-a90a-7fa886be1323 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:40.173189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d735905a-55eb-45e7-a90a-7fa886be1323 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:40.234896 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d735905a-55eb-45e7-a90a-7fa886be1323 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:40.242233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d735905a-55eb-45e7-a90a-7fa886be1323 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082130 May 24 13:25:40.242840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 767/1540] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:40 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:41.259788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a5596678-78fe-4c30-9d09-57848a8c9e34 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:41.260405 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a5596678-78fe-4c30-9d09-57848a8c9e34 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:41.267031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5596678-78fe-4c30-9d09-57848a8c9e34 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:41.267478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5596678-78fe-4c30-9d09-57848a8c9e34 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:41.268231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5596678-78fe-4c30-9d09-57848a8c9e34 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:41.268666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a5596678-78fe-4c30-9d09-57848a8c9e34 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:41.327822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a5596678-78fe-4c30-9d09-57848a8c9e34 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:41.335210 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a5596678-78fe-4c30-9d09-57848a8c9e34 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079279 May 24 13:25:41.335766 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 774/1541] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:41 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:42.352601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7d223d63-22c0-4d8c-9531-154d6c0c881b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:42.353207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7d223d63-22c0-4d8c-9531-154d6c0c881b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:42.360267 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d223d63-22c0-4d8c-9531-154d6c0c881b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:42.360707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d223d63-22c0-4d8c-9531-154d6c0c881b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:42.361455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d223d63-22c0-4d8c-9531-154d6c0c881b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:42.361882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d223d63-22c0-4d8c-9531-154d6c0c881b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:42.422638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7d223d63-22c0-4d8c-9531-154d6c0c881b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:42.430069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7d223d63-22c0-4d8c-9531-154d6c0c881b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081372 May 24 13:25:42.430658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 768/1542] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:42 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:43.447610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-06bc26d5-3184-4685-bbfd-ceb343fb7b3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:43.448228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-06bc26d5-3184-4685-bbfd-ceb343fb7b3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:43.455381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-06bc26d5-3184-4685-bbfd-ceb343fb7b3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:43.455834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-06bc26d5-3184-4685-bbfd-ceb343fb7b3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:43.456626 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-06bc26d5-3184-4685-bbfd-ceb343fb7b3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:43.457063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-06bc26d5-3184-4685-bbfd-ceb343fb7b3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:43.516700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-06bc26d5-3184-4685-bbfd-ceb343fb7b3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:43.524383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-06bc26d5-3184-4685-bbfd-ceb343fb7b3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080629 May 24 13:25:43.525021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 775/1543] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:43 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:44.541374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9dcc0acb-7266-44c6-ab9b-86366bec50c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:44.541984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9dcc0acb-7266-44c6-ab9b-86366bec50c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:44.549085 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9dcc0acb-7266-44c6-ab9b-86366bec50c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:44.549528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9dcc0acb-7266-44c6-ab9b-86366bec50c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:44.550275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9dcc0acb-7266-44c6-ab9b-86366bec50c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:44.550725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9dcc0acb-7266-44c6-ab9b-86366bec50c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:44.612285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9dcc0acb-7266-44c6-ab9b-86366bec50c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:44.619755 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9dcc0acb-7266-44c6-ab9b-86366bec50c1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082208 May 24 13:25:44.620314 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 769/1544] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:44 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:45.636496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f801032c-15bb-4066-be48-a225ec4f1c84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:45.637111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f801032c-15bb-4066-be48-a225ec4f1c84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:45.644358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f801032c-15bb-4066-be48-a225ec4f1c84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:45.644801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f801032c-15bb-4066-be48-a225ec4f1c84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:45.645551 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f801032c-15bb-4066-be48-a225ec4f1c84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:45.645989 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f801032c-15bb-4066-be48-a225ec4f1c84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:45.712401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f801032c-15bb-4066-be48-a225ec4f1c84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:45.719950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f801032c-15bb-4066-be48-a225ec4f1c84 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.087307 May 24 13:25:45.720519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 776/1545] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:45 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:46.736970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8c2892e8-76e7-4b2f-86cb-42f5916da6e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:46.737585 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8c2892e8-76e7-4b2f-86cb-42f5916da6e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:46.744219 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c2892e8-76e7-4b2f-86cb-42f5916da6e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:46.744652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c2892e8-76e7-4b2f-86cb-42f5916da6e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:46.745421 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c2892e8-76e7-4b2f-86cb-42f5916da6e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:46.745856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c2892e8-76e7-4b2f-86cb-42f5916da6e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:46.805633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8c2892e8-76e7-4b2f-86cb-42f5916da6e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:46.813666 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8c2892e8-76e7-4b2f-86cb-42f5916da6e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080622 May 24 13:25:46.814225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 770/1546] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:46 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:47.830341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-659ea2ba-ac98-42bd-8742-ff8ee118f4f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:47.830961 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-659ea2ba-ac98-42bd-8742-ff8ee118f4f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:47.837169 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-659ea2ba-ac98-42bd-8742-ff8ee118f4f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:47.837617 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-659ea2ba-ac98-42bd-8742-ff8ee118f4f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:47.838402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-659ea2ba-ac98-42bd-8742-ff8ee118f4f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:47.838843 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-659ea2ba-ac98-42bd-8742-ff8ee118f4f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:47.898265 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-659ea2ba-ac98-42bd-8742-ff8ee118f4f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:47.906411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-659ea2ba-ac98-42bd-8742-ff8ee118f4f8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080407 May 24 13:25:47.906979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 777/1547] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:47 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:48.923051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-af1a4b57-25f2-4708-b73b-11c9b271851a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:48.924289 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-af1a4b57-25f2-4708-b73b-11c9b271851a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:48.930611 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af1a4b57-25f2-4708-b73b-11c9b271851a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:48.931053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af1a4b57-25f2-4708-b73b-11c9b271851a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:48.931806 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af1a4b57-25f2-4708-b73b-11c9b271851a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:48.932232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af1a4b57-25f2-4708-b73b-11c9b271851a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:48.994379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-af1a4b57-25f2-4708-b73b-11c9b271851a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:49.002276 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-af1a4b57-25f2-4708-b73b-11c9b271851a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083116 May 24 13:25:49.002854 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 771/1548] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:48 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:50.019646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f846fc12-295b-4c92-a479-e3dcbba0acc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:50.020267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f846fc12-295b-4c92-a479-e3dcbba0acc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:50.027048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f846fc12-295b-4c92-a479-e3dcbba0acc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:50.027495 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f846fc12-295b-4c92-a479-e3dcbba0acc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:50.028251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f846fc12-295b-4c92-a479-e3dcbba0acc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:50.028706 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f846fc12-295b-4c92-a479-e3dcbba0acc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:50.031750 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=84 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:25:50.090445 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f846fc12-295b-4c92-a479-e3dcbba0acc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:50.097798 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f846fc12-295b-4c92-a479-e3dcbba0acc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082093 May 24 13:25:50.098377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 778/1549] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:50 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:51.115389 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d6a9db30-705d-4f64-99f6-1cd69ab30c3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:51.116013 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d6a9db30-705d-4f64-99f6-1cd69ab30c3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:51.122567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6a9db30-705d-4f64-99f6-1cd69ab30c3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:51.123019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6a9db30-705d-4f64-99f6-1cd69ab30c3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:51.123784 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6a9db30-705d-4f64-99f6-1cd69ab30c3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:51.124226 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6a9db30-705d-4f64-99f6-1cd69ab30c3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:51.183309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d6a9db30-705d-4f64-99f6-1cd69ab30c3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:51.190744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d6a9db30-705d-4f64-99f6-1cd69ab30c3b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079228 May 24 13:25:51.191313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 772/1550] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:51 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:52.207434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c0354b85-cf34-4545-84a4-53b8823275e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:52.208054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c0354b85-cf34-4545-84a4-53b8823275e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:52.214680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0354b85-cf34-4545-84a4-53b8823275e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:52.215133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0354b85-cf34-4545-84a4-53b8823275e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:52.215893 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0354b85-cf34-4545-84a4-53b8823275e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:52.216334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c0354b85-cf34-4545-84a4-53b8823275e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:52.276323 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c0354b85-cf34-4545-84a4-53b8823275e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:52.283940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c0354b85-cf34-4545-84a4-53b8823275e7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080411 May 24 13:25:52.284500 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 779/1551] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:52 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:53.301361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-92b81ae3-9a6b-4609-bcc0-8be0d6935106 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:53.301907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-92b81ae3-9a6b-4609-bcc0-8be0d6935106 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:53.308353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92b81ae3-9a6b-4609-bcc0-8be0d6935106 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:53.308800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92b81ae3-9a6b-4609-bcc0-8be0d6935106 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:53.309565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92b81ae3-9a6b-4609-bcc0-8be0d6935106 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:53.309999 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92b81ae3-9a6b-4609-bcc0-8be0d6935106 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:53.369394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-92b81ae3-9a6b-4609-bcc0-8be0d6935106 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:53.376931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-92b81ae3-9a6b-4609-bcc0-8be0d6935106 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079495 May 24 13:25:53.377493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 773/1552] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:53 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:54.392905 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f0a6eb45-d169-4275-9253-fbe48da273d7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:54.393520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f0a6eb45-d169-4275-9253-fbe48da273d7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:54.400024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f0a6eb45-d169-4275-9253-fbe48da273d7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:54.400479 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f0a6eb45-d169-4275-9253-fbe48da273d7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:54.401241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f0a6eb45-d169-4275-9253-fbe48da273d7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:54.401681 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f0a6eb45-d169-4275-9253-fbe48da273d7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:54.464531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f0a6eb45-d169-4275-9253-fbe48da273d7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:54.471951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f0a6eb45-d169-4275-9253-fbe48da273d7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082919 May 24 13:25:54.472490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 780/1553] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:54 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:55.488737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5acc92f5-a9c7-48ae-9eef-9250f22be8f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:55.489354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5acc92f5-a9c7-48ae-9eef-9250f22be8f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:55.495836 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5acc92f5-a9c7-48ae-9eef-9250f22be8f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:55.496284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5acc92f5-a9c7-48ae-9eef-9250f22be8f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:55.497040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5acc92f5-a9c7-48ae-9eef-9250f22be8f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:55.497475 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5acc92f5-a9c7-48ae-9eef-9250f22be8f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:55.501338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=84 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:25:55.557884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5acc92f5-a9c7-48ae-9eef-9250f22be8f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:55.565469 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5acc92f5-a9c7-48ae-9eef-9250f22be8f6 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080577 May 24 13:25:55.566030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 774/1554] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:55 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:56.582304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ea089543-8f73-444f-b570-1257269d59d9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:56.582939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ea089543-8f73-444f-b570-1257269d59d9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:56.589921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea089543-8f73-444f-b570-1257269d59d9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:56.590402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea089543-8f73-444f-b570-1257269d59d9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:56.591207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea089543-8f73-444f-b570-1257269d59d9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:56.591765 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ea089543-8f73-444f-b570-1257269d59d9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:56.653606 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ea089543-8f73-444f-b570-1257269d59d9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:56.661072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ea089543-8f73-444f-b570-1257269d59d9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082691 May 24 13:25:56.661631 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 781/1555] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:56 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:57.677892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1ecf1b1-4f16-4622-a100-fbcb0d6ad1bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:57.678507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c1ecf1b1-4f16-4622-a100-fbcb0d6ad1bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:57.685483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ecf1b1-4f16-4622-a100-fbcb0d6ad1bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:57.685933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ecf1b1-4f16-4622-a100-fbcb0d6ad1bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:57.686726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ecf1b1-4f16-4622-a100-fbcb0d6ad1bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:57.687168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ecf1b1-4f16-4622-a100-fbcb0d6ad1bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:57.751481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c1ecf1b1-4f16-4622-a100-fbcb0d6ad1bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:57.759344 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c1ecf1b1-4f16-4622-a100-fbcb0d6ad1bd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085350 May 24 13:25:57.759908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 775/1556] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:57 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:58.777069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e16eeda7-cf2d-4c8d-8024-58009410055c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:58.777723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e16eeda7-cf2d-4c8d-8024-58009410055c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:58.784698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e16eeda7-cf2d-4c8d-8024-58009410055c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:58.785145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e16eeda7-cf2d-4c8d-8024-58009410055c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:58.785903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e16eeda7-cf2d-4c8d-8024-58009410055c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:58.786363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e16eeda7-cf2d-4c8d-8024-58009410055c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:58.846633 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e16eeda7-cf2d-4c8d-8024-58009410055c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:58.854102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e16eeda7-cf2d-4c8d-8024-58009410055c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080937 May 24 13:25:58.854696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 782/1557] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:58 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:25:59.870830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-237a13bd-315a-486f-bdcb-6f09438ab84f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:25:59.871484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-237a13bd-315a-486f-bdcb-6f09438ab84f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:25:59.878680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-237a13bd-315a-486f-bdcb-6f09438ab84f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:59.879130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-237a13bd-315a-486f-bdcb-6f09438ab84f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:59.879893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-237a13bd-315a-486f-bdcb-6f09438ab84f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:25:59.880333 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-237a13bd-315a-486f-bdcb-6f09438ab84f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:25:59.941251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-237a13bd-315a-486f-bdcb-6f09438ab84f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:25:59.948727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-237a13bd-315a-486f-bdcb-6f09438ab84f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082089 May 24 13:25:59.949288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 776/1558] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:25:59 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:00.965536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ec89eed6-d5b3-4808-9cac-f4ba4a90d2af tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:00.966135 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ec89eed6-d5b3-4808-9cac-f4ba4a90d2af tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:00.973239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec89eed6-d5b3-4808-9cac-f4ba4a90d2af tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:00.973689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec89eed6-d5b3-4808-9cac-f4ba4a90d2af tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:00.974505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec89eed6-d5b3-4808-9cac-f4ba4a90d2af tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:00.974943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ec89eed6-d5b3-4808-9cac-f4ba4a90d2af tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:01.037412 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ec89eed6-d5b3-4808-9cac-f4ba4a90d2af tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:01.044971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ec89eed6-d5b3-4808-9cac-f4ba4a90d2af tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083280 May 24 13:26:01.045531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 783/1559] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:00 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:02.062596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-016641cb-3b73-452e-a4b3-de02cdb2ffc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:02.064361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-016641cb-3b73-452e-a4b3-de02cdb2ffc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:02.073124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-016641cb-3b73-452e-a4b3-de02cdb2ffc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:02.073730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-016641cb-3b73-452e-a4b3-de02cdb2ffc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:02.074532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-016641cb-3b73-452e-a4b3-de02cdb2ffc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:02.074971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-016641cb-3b73-452e-a4b3-de02cdb2ffc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:02.134817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-016641cb-3b73-452e-a4b3-de02cdb2ffc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:02.142329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-016641cb-3b73-452e-a4b3-de02cdb2ffc0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084388 May 24 13:26:02.142909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 777/1560] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:02 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:03.158251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ce75aa39-79f4-4818-96fa-47d77fa26336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:03.158890 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ce75aa39-79f4-4818-96fa-47d77fa26336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:03.165366 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce75aa39-79f4-4818-96fa-47d77fa26336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:03.165810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce75aa39-79f4-4818-96fa-47d77fa26336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:03.166590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce75aa39-79f4-4818-96fa-47d77fa26336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:03.167031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ce75aa39-79f4-4818-96fa-47d77fa26336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:03.228565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ce75aa39-79f4-4818-96fa-47d77fa26336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:03.236244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ce75aa39-79f4-4818-96fa-47d77fa26336 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081801 May 24 13:26:03.236802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 784/1561] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:03 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:04.252919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-24c51a55-9aaa-46e2-9200-cf37bee0d68f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:04.253528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-24c51a55-9aaa-46e2-9200-cf37bee0d68f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:04.260005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24c51a55-9aaa-46e2-9200-cf37bee0d68f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:04.260456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24c51a55-9aaa-46e2-9200-cf37bee0d68f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:04.261211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24c51a55-9aaa-46e2-9200-cf37bee0d68f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:04.261647 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24c51a55-9aaa-46e2-9200-cf37bee0d68f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:04.324266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-24c51a55-9aaa-46e2-9200-cf37bee0d68f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:04.332339 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-24c51a55-9aaa-46e2-9200-cf37bee0d68f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083302 May 24 13:26:04.332900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 778/1562] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:04 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:05.349962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4a928edf-11aa-4829-9008-62d5bff24dbc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:05.350614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4a928edf-11aa-4829-9008-62d5bff24dbc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:05.357368 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4a928edf-11aa-4829-9008-62d5bff24dbc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:05.357819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4a928edf-11aa-4829-9008-62d5bff24dbc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:05.358860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4a928edf-11aa-4829-9008-62d5bff24dbc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:05.359065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4a928edf-11aa-4829-9008-62d5bff24dbc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:05.418807 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-4a928edf-11aa-4829-9008-62d5bff24dbc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:05.426382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4a928edf-11aa-4829-9008-62d5bff24dbc tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080277 May 24 13:26:05.426939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 785/1563] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:05 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:06.443696 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eca727ac-a604-4b31-95c6-a327e9d2c81e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:06.444309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eca727ac-a604-4b31-95c6-a327e9d2c81e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:06.450794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca727ac-a604-4b31-95c6-a327e9d2c81e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:06.451240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca727ac-a604-4b31-95c6-a327e9d2c81e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:06.451992 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca727ac-a604-4b31-95c6-a327e9d2c81e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:06.452423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca727ac-a604-4b31-95c6-a327e9d2c81e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:06.515080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eca727ac-a604-4b31-95c6-a327e9d2c81e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:06.522474 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eca727ac-a604-4b31-95c6-a327e9d2c81e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082620 May 24 13:26:06.523030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 779/1564] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:06 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:07.539403 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2debb53b-4198-4c64-bc4d-8de932644410 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:07.540023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2debb53b-4198-4c64-bc4d-8de932644410 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:07.542353 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=28 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:26:07.547606 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2debb53b-4198-4c64-bc4d-8de932644410 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:07.548058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2debb53b-4198-4c64-bc4d-8de932644410 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:07.548819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2debb53b-4198-4c64-bc4d-8de932644410 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:07.549253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2debb53b-4198-4c64-bc4d-8de932644410 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:07.608753 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2debb53b-4198-4c64-bc4d-8de932644410 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:07.616157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2debb53b-4198-4c64-bc4d-8de932644410 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080644 May 24 13:26:07.616718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 786/1565] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:07 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:26:08.634107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1773b2bb-9837-48e3-8bcd-9751acbceb31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:08.634671 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1773b2bb-9837-48e3-8bcd-9751acbceb31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:08.636991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=28 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:26:08.642515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1773b2bb-9837-48e3-8bcd-9751acbceb31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:08.642960 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1773b2bb-9837-48e3-8bcd-9751acbceb31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:08.643708 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1773b2bb-9837-48e3-8bcd-9751acbceb31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:08.644138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1773b2bb-9837-48e3-8bcd-9751acbceb31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:08.703489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1773b2bb-9837-48e3-8bcd-9751acbceb31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:08.710907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1773b2bb-9837-48e3-8bcd-9751acbceb31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080725 May 24 13:26:08.711452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 780/1566] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:08 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:09.727780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8cac8aa6-c1a1-40ba-8a5c-a077a0793b50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:09.728334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8cac8aa6-c1a1-40ba-8a5c-a077a0793b50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:09.735051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8cac8aa6-c1a1-40ba-8a5c-a077a0793b50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:09.735501 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8cac8aa6-c1a1-40ba-8a5c-a077a0793b50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:09.736258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8cac8aa6-c1a1-40ba-8a5c-a077a0793b50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:09.736695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8cac8aa6-c1a1-40ba-8a5c-a077a0793b50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:09.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8cac8aa6-c1a1-40ba-8a5c-a077a0793b50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:09.803757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8cac8aa6-c1a1-40ba-8a5c-a077a0793b50 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079925 May 24 13:26:09.804324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 787/1567] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:09 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:10.820949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6e63017b-2ea4-484c-8c7b-81108ada674e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:10.821564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6e63017b-2ea4-484c-8c7b-81108ada674e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:10.828608 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e63017b-2ea4-484c-8c7b-81108ada674e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:10.829052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e63017b-2ea4-484c-8c7b-81108ada674e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:10.829808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e63017b-2ea4-484c-8c7b-81108ada674e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:10.830237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e63017b-2ea4-484c-8c7b-81108ada674e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:10.890253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6e63017b-2ea4-484c-8c7b-81108ada674e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:10.897528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6e63017b-2ea4-484c-8c7b-81108ada674e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080427 May 24 13:26:10.898093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 781/1568] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:10 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:11.914529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3f9f98c2-88c9-4974-a75e-95c9148ac340 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:11.915141 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3f9f98c2-88c9-4974-a75e-95c9148ac340 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:11.922517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3f9f98c2-88c9-4974-a75e-95c9148ac340 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:11.922973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3f9f98c2-88c9-4974-a75e-95c9148ac340 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:11.923747 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3f9f98c2-88c9-4974-a75e-95c9148ac340 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:11.924191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3f9f98c2-88c9-4974-a75e-95c9148ac340 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:11.986591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3f9f98c2-88c9-4974-a75e-95c9148ac340 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:11.994019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3f9f98c2-88c9-4974-a75e-95c9148ac340 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083445 May 24 13:26:11.994633 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 788/1569] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:11 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:13.010789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5ddc3bbb-1c61-4e06-a425-4c99dc65bfc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:13.011396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5ddc3bbb-1c61-4e06-a425-4c99dc65bfc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:13.018439 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ddc3bbb-1c61-4e06-a425-4c99dc65bfc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:13.018884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ddc3bbb-1c61-4e06-a425-4c99dc65bfc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:13.019640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ddc3bbb-1c61-4e06-a425-4c99dc65bfc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:13.020067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ddc3bbb-1c61-4e06-a425-4c99dc65bfc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:13.080458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ddc3bbb-1c61-4e06-a425-4c99dc65bfc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:13.087916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5ddc3bbb-1c61-4e06-a425-4c99dc65bfc3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080969 May 24 13:26:13.088470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 782/1570] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:13 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:14.104552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cf9ae11a-80a5-4e1c-a415-6b9c001eb1ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:14.105178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cf9ae11a-80a5-4e1c-a415-6b9c001eb1ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:14.112013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf9ae11a-80a5-4e1c-a415-6b9c001eb1ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:14.112467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf9ae11a-80a5-4e1c-a415-6b9c001eb1ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:14.113220 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf9ae11a-80a5-4e1c-a415-6b9c001eb1ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:14.113656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cf9ae11a-80a5-4e1c-a415-6b9c001eb1ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:14.177801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cf9ae11a-80a5-4e1c-a415-6b9c001eb1ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:14.185678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cf9ae11a-80a5-4e1c-a415-6b9c001eb1ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084471 May 24 13:26:14.186248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 789/1571] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:14 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:15.202629 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-063207af-6440-4060-8bd5-11e320652169 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:15.203246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-063207af-6440-4060-8bd5-11e320652169 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:15.209668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-063207af-6440-4060-8bd5-11e320652169 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:15.210112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-063207af-6440-4060-8bd5-11e320652169 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:15.210907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-063207af-6440-4060-8bd5-11e320652169 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:15.211347 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-063207af-6440-4060-8bd5-11e320652169 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:15.275721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-063207af-6440-4060-8bd5-11e320652169 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:15.283702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-063207af-6440-4060-8bd5-11e320652169 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084948 May 24 13:26:15.284269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 783/1572] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:15 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:16.300500 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dd91667c-e668-47aa-9b3b-d89446f5d560 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:16.301109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dd91667c-e668-47aa-9b3b-d89446f5d560 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:16.307535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd91667c-e668-47aa-9b3b-d89446f5d560 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:16.307980 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd91667c-e668-47aa-9b3b-d89446f5d560 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:16.308728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd91667c-e668-47aa-9b3b-d89446f5d560 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:16.309161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd91667c-e668-47aa-9b3b-d89446f5d560 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:16.369598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dd91667c-e668-47aa-9b3b-d89446f5d560 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:16.377701 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dd91667c-e668-47aa-9b3b-d89446f5d560 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081034 May 24 13:26:16.378260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 790/1573] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:16 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:17.395067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5db9486c-d498-4b82-8fc7-62833bf81c44 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:17.395676 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5db9486c-d498-4b82-8fc7-62833bf81c44 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:17.402136 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5db9486c-d498-4b82-8fc7-62833bf81c44 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:17.402606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5db9486c-d498-4b82-8fc7-62833bf81c44 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:17.403359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5db9486c-d498-4b82-8fc7-62833bf81c44 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:17.403787 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5db9486c-d498-4b82-8fc7-62833bf81c44 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:17.463525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5db9486c-d498-4b82-8fc7-62833bf81c44 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:17.471030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5db9486c-d498-4b82-8fc7-62833bf81c44 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079836 May 24 13:26:17.471595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 784/1574] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:17 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:18.488299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c444ac58-4719-45fb-b125-ff73ab8dfe22 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:18.488903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c444ac58-4719-45fb-b125-ff73ab8dfe22 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:18.496231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c444ac58-4719-45fb-b125-ff73ab8dfe22 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:18.496689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c444ac58-4719-45fb-b125-ff73ab8dfe22 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:18.497465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c444ac58-4719-45fb-b125-ff73ab8dfe22 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:18.497905 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c444ac58-4719-45fb-b125-ff73ab8dfe22 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:18.558768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c444ac58-4719-45fb-b125-ff73ab8dfe22 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:18.566113 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c444ac58-4719-45fb-b125-ff73ab8dfe22 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081741 May 24 13:26:18.566712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 791/1575] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:18 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:19.583335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-74694ce7-f1cd-4bf3-8e8d-2176d9c2b22f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:19.583979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-74694ce7-f1cd-4bf3-8e8d-2176d9c2b22f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:19.590595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74694ce7-f1cd-4bf3-8e8d-2176d9c2b22f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:19.591556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74694ce7-f1cd-4bf3-8e8d-2176d9c2b22f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:19.592426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74694ce7-f1cd-4bf3-8e8d-2176d9c2b22f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:19.592866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74694ce7-f1cd-4bf3-8e8d-2176d9c2b22f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:19.655341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-74694ce7-f1cd-4bf3-8e8d-2176d9c2b22f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:19.663426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-74694ce7-f1cd-4bf3-8e8d-2176d9c2b22f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083901 May 24 13:26:19.663977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 785/1576] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:19 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:20.680955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0d5d9274-73fe-43d2-ae7f-85d5968a891a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:20.681482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0d5d9274-73fe-43d2-ae7f-85d5968a891a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:20.688745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d5d9274-73fe-43d2-ae7f-85d5968a891a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:20.689193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d5d9274-73fe-43d2-ae7f-85d5968a891a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:20.689946 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d5d9274-73fe-43d2-ae7f-85d5968a891a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:20.690400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d5d9274-73fe-43d2-ae7f-85d5968a891a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:20.692918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=84 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:26:20.754431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0d5d9274-73fe-43d2-ae7f-85d5968a891a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:20.761909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0d5d9274-73fe-43d2-ae7f-85d5968a891a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084870 May 24 13:26:20.762509 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 792/1577] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:20 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:21.779239 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-18728aaf-58b8-48de-88ca-a4aff0a28e3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:21.779782 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-18728aaf-58b8-48de-88ca-a4aff0a28e3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:21.786294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18728aaf-58b8-48de-88ca-a4aff0a28e3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:21.786747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18728aaf-58b8-48de-88ca-a4aff0a28e3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:21.787498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18728aaf-58b8-48de-88ca-a4aff0a28e3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:21.787928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18728aaf-58b8-48de-88ca-a4aff0a28e3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:21.847439 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-18728aaf-58b8-48de-88ca-a4aff0a28e3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:21.854858 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-18728aaf-58b8-48de-88ca-a4aff0a28e3d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080031 May 24 13:26:21.855423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 786/1578] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:21 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:26:22.872766 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cabf1e8e-515f-42b6-aa9c-63302e2ff4f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:22.878750 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cabf1e8e-515f-42b6-aa9c-63302e2ff4f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:22.881894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cabf1e8e-515f-42b6-aa9c-63302e2ff4f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:22.882380 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cabf1e8e-515f-42b6-aa9c-63302e2ff4f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:22.883145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cabf1e8e-515f-42b6-aa9c-63302e2ff4f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:22.883773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cabf1e8e-515f-42b6-aa9c-63302e2ff4f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:23.074585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-cabf1e8e-515f-42b6-aa9c-63302e2ff4f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:23.082800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cabf1e8e-515f-42b6-aa9c-63302e2ff4f3 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.213960 May 24 13:26:23.083384 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 793/1579] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:22 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:24.100262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2a64dee2-873f-4ff9-8c24-4cabc8b0ebc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:24.100801 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2a64dee2-873f-4ff9-8c24-4cabc8b0ebc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:24.108207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a64dee2-873f-4ff9-8c24-4cabc8b0ebc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:24.108664 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a64dee2-873f-4ff9-8c24-4cabc8b0ebc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:24.109427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a64dee2-873f-4ff9-8c24-4cabc8b0ebc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:24.109866 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a64dee2-873f-4ff9-8c24-4cabc8b0ebc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:24.174718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2a64dee2-873f-4ff9-8c24-4cabc8b0ebc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:24.182292 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2a64dee2-873f-4ff9-8c24-4cabc8b0ebc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.085970 May 24 13:26:24.182865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 787/1580] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:24 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:25.200553 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fd378692-af7f-4ef0-a8de-7bf0e8e87bc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:25.201174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fd378692-af7f-4ef0-a8de-7bf0e8e87bc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:25.208273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fd378692-af7f-4ef0-a8de-7bf0e8e87bc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:25.208727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fd378692-af7f-4ef0-a8de-7bf0e8e87bc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:25.209489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fd378692-af7f-4ef0-a8de-7bf0e8e87bc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:25.209925 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fd378692-af7f-4ef0-a8de-7bf0e8e87bc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:25.269273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-fd378692-af7f-4ef0-a8de-7bf0e8e87bc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:25.276738 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fd378692-af7f-4ef0-a8de-7bf0e8e87bc9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080029 May 24 13:26:25.277309 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 794/1581] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:25 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:26.293296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6cddb5d5-0aee-4f18-a58a-361bf5395f19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:26.293895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6cddb5d5-0aee-4f18-a58a-361bf5395f19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:26.301027 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6cddb5d5-0aee-4f18-a58a-361bf5395f19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:26.301480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6cddb5d5-0aee-4f18-a58a-361bf5395f19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:26.302250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6cddb5d5-0aee-4f18-a58a-361bf5395f19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:26.302710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6cddb5d5-0aee-4f18-a58a-361bf5395f19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:26.306679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=84 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:26:26.426591 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6cddb5d5-0aee-4f18-a58a-361bf5395f19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:26.434206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6cddb5d5-0aee-4f18-a58a-361bf5395f19 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.144810 May 24 13:26:26.434921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 788/1582] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:26 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:27.450818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3ff9e1be-9e1f-4573-a501-09c94489057d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:27.451449 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3ff9e1be-9e1f-4573-a501-09c94489057d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:27.457967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ff9e1be-9e1f-4573-a501-09c94489057d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:27.458460 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ff9e1be-9e1f-4573-a501-09c94489057d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:27.459222 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ff9e1be-9e1f-4573-a501-09c94489057d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:27.459657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3ff9e1be-9e1f-4573-a501-09c94489057d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:27.520381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3ff9e1be-9e1f-4573-a501-09c94489057d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:27.527878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3ff9e1be-9e1f-4573-a501-09c94489057d tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080894 May 24 13:26:27.528449 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 795/1583] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:27 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:28.544503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-256f319e-10c6-42e9-a165-82fbaa2b1153 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:28.545110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-256f319e-10c6-42e9-a165-82fbaa2b1153 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:28.552192 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-256f319e-10c6-42e9-a165-82fbaa2b1153 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:28.552633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-256f319e-10c6-42e9-a165-82fbaa2b1153 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:28.553382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-256f319e-10c6-42e9-a165-82fbaa2b1153 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:28.553810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-256f319e-10c6-42e9-a165-82fbaa2b1153 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:28.618054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-256f319e-10c6-42e9-a165-82fbaa2b1153 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:28.625622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-256f319e-10c6-42e9-a165-82fbaa2b1153 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084960 May 24 13:26:28.626195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 789/1584] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:28 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:29.641936 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5e554672-df03-4f18-9ee4-3a402fa7321c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:29.642560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5e554672-df03-4f18-9ee4-3a402fa7321c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:29.649065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e554672-df03-4f18-9ee4-3a402fa7321c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:29.649518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e554672-df03-4f18-9ee4-3a402fa7321c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:29.650271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e554672-df03-4f18-9ee4-3a402fa7321c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:29.650731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5e554672-df03-4f18-9ee4-3a402fa7321c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:29.712759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5e554672-df03-4f18-9ee4-3a402fa7321c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:29.720407 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5e554672-df03-4f18-9ee4-3a402fa7321c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082297 May 24 13:26:29.720974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 796/1585] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:29 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:30.737128 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-be8b7a67-e337-4067-9ce7-eac9c29707e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:30.737687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-be8b7a67-e337-4067-9ce7-eac9c29707e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:30.744177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be8b7a67-e337-4067-9ce7-eac9c29707e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:30.744630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be8b7a67-e337-4067-9ce7-eac9c29707e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:30.745871 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be8b7a67-e337-4067-9ce7-eac9c29707e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:30.746338 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be8b7a67-e337-4067-9ce7-eac9c29707e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:30.967801 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-be8b7a67-e337-4067-9ce7-eac9c29707e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:30.975183 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-be8b7a67-e337-4067-9ce7-eac9c29707e9 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.241984 May 24 13:26:30.975742 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 790/1586] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:30 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:31.992808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ace792d3-be55-4b45-826e-b2f344be33e2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:31.993423 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ace792d3-be55-4b45-826e-b2f344be33e2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:32.000496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ace792d3-be55-4b45-826e-b2f344be33e2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:32.000947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ace792d3-be55-4b45-826e-b2f344be33e2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:32.001711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ace792d3-be55-4b45-826e-b2f344be33e2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:32.002154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ace792d3-be55-4b45-826e-b2f344be33e2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:32.063342 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ace792d3-be55-4b45-826e-b2f344be33e2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:32.070904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ace792d3-be55-4b45-826e-b2f344be33e2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081962 May 24 13:26:32.071479 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 797/1587] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:31 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:26:33.087282 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-42f3af22-f7fd-4063-971b-a53e860078d0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:33.087869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-42f3af22-f7fd-4063-971b-a53e860078d0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:33.095020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42f3af22-f7fd-4063-971b-a53e860078d0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:33.095410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42f3af22-f7fd-4063-971b-a53e860078d0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:33.096157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42f3af22-f7fd-4063-971b-a53e860078d0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:33.096584 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42f3af22-f7fd-4063-971b-a53e860078d0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:33.160312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-42f3af22-f7fd-4063-971b-a53e860078d0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:33.168114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-42f3af22-f7fd-4063-971b-a53e860078d0 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084695 May 24 13:26:33.168655 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 791/1588] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:33 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:26:34.185435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9fd8364b-67c7-4dd8-8be0-825a74824ac2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:34.186729 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9fd8364b-67c7-4dd8-8be0-825a74824ac2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:34.193226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9fd8364b-67c7-4dd8-8be0-825a74824ac2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:34.193668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9fd8364b-67c7-4dd8-8be0-825a74824ac2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:34.194444 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9fd8364b-67c7-4dd8-8be0-825a74824ac2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:34.194878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9fd8364b-67c7-4dd8-8be0-825a74824ac2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:34.264304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-9fd8364b-67c7-4dd8-8be0-825a74824ac2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:34.271798 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9fd8364b-67c7-4dd8-8be0-825a74824ac2 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.090317 May 24 13:26:34.272360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 798/1589] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:34 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:35.288111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a7293af3-3226-4e48-bf66-28651345c619 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:35.288727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a7293af3-3226-4e48-bf66-28651345c619 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:35.295180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7293af3-3226-4e48-bf66-28651345c619 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:35.295623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7293af3-3226-4e48-bf66-28651345c619 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:35.296381 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7293af3-3226-4e48-bf66-28651345c619 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:35.296813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7293af3-3226-4e48-bf66-28651345c619 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:35.357044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a7293af3-3226-4e48-bf66-28651345c619 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:35.364477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a7293af3-3226-4e48-bf66-28651345c619 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080289 May 24 13:26:35.365034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 792/1590] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:35 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:36.381684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-af91eb0a-a7aa-4f3a-9a4b-1294f9d6e89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:36.382311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-af91eb0a-a7aa-4f3a-9a4b-1294f9d6e89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:36.389387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-af91eb0a-a7aa-4f3a-9a4b-1294f9d6e89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:36.389827 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-af91eb0a-a7aa-4f3a-9a4b-1294f9d6e89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:36.390632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-af91eb0a-a7aa-4f3a-9a4b-1294f9d6e89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:36.391061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-af91eb0a-a7aa-4f3a-9a4b-1294f9d6e89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:36.453290 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-af91eb0a-a7aa-4f3a-9a4b-1294f9d6e89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:36.461016 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-af91eb0a-a7aa-4f3a-9a4b-1294f9d6e89a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083214 May 24 13:26:36.461779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 799/1591] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:36 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:37.478643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6d2f66ab-4ce9-4be4-b808-5b7ef16b5537 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:37.479247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6d2f66ab-4ce9-4be4-b808-5b7ef16b5537 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:37.486612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d2f66ab-4ce9-4be4-b808-5b7ef16b5537 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:37.487052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d2f66ab-4ce9-4be4-b808-5b7ef16b5537 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:37.487815 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d2f66ab-4ce9-4be4-b808-5b7ef16b5537 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:37.488241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d2f66ab-4ce9-4be4-b808-5b7ef16b5537 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:37.547557 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6d2f66ab-4ce9-4be4-b808-5b7ef16b5537 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:37.554921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6d2f66ab-4ce9-4be4-b808-5b7ef16b5537 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080315 May 24 13:26:37.555466 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 793/1592] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:37 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:38.571849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-de47c3f5-e494-425e-92da-8b3bb9f23e24 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:38.572469 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-de47c3f5-e494-425e-92da-8b3bb9f23e24 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:38.574820 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=28 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:26:38.580887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de47c3f5-e494-425e-92da-8b3bb9f23e24 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:38.581279 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de47c3f5-e494-425e-92da-8b3bb9f23e24 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:38.582041 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de47c3f5-e494-425e-92da-8b3bb9f23e24 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:38.582518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-de47c3f5-e494-425e-92da-8b3bb9f23e24 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:38.644421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-de47c3f5-e494-425e-92da-8b3bb9f23e24 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:38.651875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-de47c3f5-e494-425e-92da-8b3bb9f23e24 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083949 May 24 13:26:38.652439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 800/1593] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:38 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:39.669190 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c8986342-410d-4eb6-a062-6f406fbd17da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:39.669746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c8986342-410d-4eb6-a062-6f406fbd17da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:39.672593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=28 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:26:39.677936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8986342-410d-4eb6-a062-6f406fbd17da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:39.678422 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8986342-410d-4eb6-a062-6f406fbd17da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:39.679198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8986342-410d-4eb6-a062-6f406fbd17da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:39.679637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8986342-410d-4eb6-a062-6f406fbd17da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:39.739649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c8986342-410d-4eb6-a062-6f406fbd17da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:39.747189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c8986342-410d-4eb6-a062-6f406fbd17da tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081997 May 24 13:26:39.747747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 794/1594] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:39 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:40.698453 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:26:40.699106 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:26:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:26:40.763992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5b72e186-9570-47b2-91fa-d557b4669556 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:40.764605 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5b72e186-9570-47b2-91fa-d557b4669556 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:40.771147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b72e186-9570-47b2-91fa-d557b4669556 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:40.771590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b72e186-9570-47b2-91fa-d557b4669556 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:40.772342 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b72e186-9570-47b2-91fa-d557b4669556 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:40.772774 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b72e186-9570-47b2-91fa-d557b4669556 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:40.831704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-5b72e186-9570-47b2-91fa-d557b4669556 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:40.839185 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5b72e186-9570-47b2-91fa-d557b4669556 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.078979 May 24 13:26:40.839737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 801/1595] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:40 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:40.930600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:26:40.930770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:26:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:26:41.855620 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fe8960dd-a62e-43e5-92db-398fdfb9aa52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:41.856523 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fe8960dd-a62e-43e5-92db-398fdfb9aa52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:41.863066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe8960dd-a62e-43e5-92db-398fdfb9aa52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:41.863521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe8960dd-a62e-43e5-92db-398fdfb9aa52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:41.864316 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe8960dd-a62e-43e5-92db-398fdfb9aa52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:41.864763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe8960dd-a62e-43e5-92db-398fdfb9aa52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:41.927107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fe8960dd-a62e-43e5-92db-398fdfb9aa52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:41.934585 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fe8960dd-a62e-43e5-92db-398fdfb9aa52 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082793 May 24 13:26:41.935142 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 795/1596] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:41 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:42.951751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2e9fb049-a4f4-42bc-b84a-dcbebe960c9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:42.952430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2e9fb049-a4f4-42bc-b84a-dcbebe960c9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:42.959415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e9fb049-a4f4-42bc-b84a-dcbebe960c9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:42.959865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e9fb049-a4f4-42bc-b84a-dcbebe960c9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:42.960629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e9fb049-a4f4-42bc-b84a-dcbebe960c9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:42.961068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2e9fb049-a4f4-42bc-b84a-dcbebe960c9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:43.020679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2e9fb049-a4f4-42bc-b84a-dcbebe960c9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:43.028260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2e9fb049-a4f4-42bc-b84a-dcbebe960c9b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080569 May 24 13:26:43.028815 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 802/1597] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:42 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:44.044111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5d6f989b-7c57-486f-a114-85142eddc6eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:44.044730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5d6f989b-7c57-486f-a114-85142eddc6eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:44.051246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d6f989b-7c57-486f-a114-85142eddc6eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:44.051719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d6f989b-7c57-486f-a114-85142eddc6eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:44.052574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d6f989b-7c57-486f-a114-85142eddc6eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:44.052892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d6f989b-7c57-486f-a114-85142eddc6eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:44.114618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5d6f989b-7c57-486f-a114-85142eddc6eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:44.121948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5d6f989b-7c57-486f-a114-85142eddc6eb tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081666 May 24 13:26:44.122532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 796/1598] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:44 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:45.139215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c6391b1c-4079-43f6-8361-5efe60dae7ef tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:45.139825 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c6391b1c-4079-43f6-8361-5efe60dae7ef tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:45.147184 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6391b1c-4079-43f6-8361-5efe60dae7ef tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:45.147628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6391b1c-4079-43f6-8361-5efe60dae7ef tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:45.148385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6391b1c-4079-43f6-8361-5efe60dae7ef tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:45.148818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6391b1c-4079-43f6-8361-5efe60dae7ef tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:45.207789 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-c6391b1c-4079-43f6-8361-5efe60dae7ef tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:45.215168 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c6391b1c-4079-43f6-8361-5efe60dae7ef tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079858 May 24 13:26:45.215730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 803/1599] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:45 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:46.232900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e5f67b97-58d2-4b97-9518-e203e434cd6c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:46.233458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e5f67b97-58d2-4b97-9518-e203e434cd6c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:46.240484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5f67b97-58d2-4b97-9518-e203e434cd6c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:46.240929 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5f67b97-58d2-4b97-9518-e203e434cd6c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:46.241693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5f67b97-58d2-4b97-9518-e203e434cd6c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:46.242127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5f67b97-58d2-4b97-9518-e203e434cd6c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:46.302127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e5f67b97-58d2-4b97-9518-e203e434cd6c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:46.309457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e5f67b97-58d2-4b97-9518-e203e434cd6c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080963 May 24 13:26:46.310007 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 797/1600] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:46 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:47.326417 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8acfc9a6-71b1-493a-8821-501900dd2b33 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:47.327022 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8acfc9a6-71b1-493a-8821-501900dd2b33 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:47.334585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8acfc9a6-71b1-493a-8821-501900dd2b33 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:47.335032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8acfc9a6-71b1-493a-8821-501900dd2b33 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:47.335795 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8acfc9a6-71b1-493a-8821-501900dd2b33 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:47.336231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8acfc9a6-71b1-493a-8821-501900dd2b33 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:47.407244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8acfc9a6-71b1-493a-8821-501900dd2b33 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:47.414882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8acfc9a6-71b1-493a-8821-501900dd2b33 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.092573 May 24 13:26:47.415450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 804/1601] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:47 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:48.432376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f10935f2-1b35-42cf-885f-2d827f990e1f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:48.432989 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f10935f2-1b35-42cf-885f-2d827f990e1f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:48.439713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f10935f2-1b35-42cf-885f-2d827f990e1f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:48.440162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f10935f2-1b35-42cf-885f-2d827f990e1f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:48.440919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f10935f2-1b35-42cf-885f-2d827f990e1f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:48.441352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f10935f2-1b35-42cf-885f-2d827f990e1f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:48.501981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f10935f2-1b35-42cf-885f-2d827f990e1f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:48.509777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f10935f2-1b35-42cf-885f-2d827f990e1f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081482 May 24 13:26:48.510371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 798/1602] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:48 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:49.527261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a426cf41-e35b-4b36-b220-bbf17f76e71a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:49.527867 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a426cf41-e35b-4b36-b220-bbf17f76e71a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:49.534301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a426cf41-e35b-4b36-b220-bbf17f76e71a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:49.534758 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a426cf41-e35b-4b36-b220-bbf17f76e71a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:49.535510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a426cf41-e35b-4b36-b220-bbf17f76e71a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:49.535943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a426cf41-e35b-4b36-b220-bbf17f76e71a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:49.595550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a426cf41-e35b-4b36-b220-bbf17f76e71a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:49.602982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a426cf41-e35b-4b36-b220-bbf17f76e71a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079594 May 24 13:26:49.603563 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 805/1603] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:49 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:50.288547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:26:50.288821 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:26:50.620951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b927eb56-b869-4ceb-b224-5ddd37f3eec8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:50.621560 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b927eb56-b869-4ceb-b224-5ddd37f3eec8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:50.628748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b927eb56-b869-4ceb-b224-5ddd37f3eec8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:50.629191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b927eb56-b869-4ceb-b224-5ddd37f3eec8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:50.629949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b927eb56-b869-4ceb-b224-5ddd37f3eec8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:50.630423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b927eb56-b869-4ceb-b224-5ddd37f3eec8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:50.694967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b927eb56-b869-4ceb-b224-5ddd37f3eec8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:50.705362 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b927eb56-b869-4ceb-b224-5ddd37f3eec8 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.087809 May 24 13:26:50.706423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 799/1604] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:50 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:51.722972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3342ef01-e1b5-4b2c-a2b4-165e73965ce5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:51.723523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3342ef01-e1b5-4b2c-a2b4-165e73965ce5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:51.729985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3342ef01-e1b5-4b2c-a2b4-165e73965ce5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:51.730467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3342ef01-e1b5-4b2c-a2b4-165e73965ce5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:51.731487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3342ef01-e1b5-4b2c-a2b4-165e73965ce5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:51.731919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3342ef01-e1b5-4b2c-a2b4-165e73965ce5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:51.734437 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=84 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:26:51.792305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3342ef01-e1b5-4b2c-a2b4-165e73965ce5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:51.799802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3342ef01-e1b5-4b2c-a2b4-165e73965ce5 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080862 May 24 13:26:51.800360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 806/1605] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:51 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:52.816273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a4dca044-931e-428f-8eff-27506d5cc1df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:52.816886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a4dca044-931e-428f-8eff-27506d5cc1df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:52.823427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4dca044-931e-428f-8eff-27506d5cc1df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:52.823874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4dca044-931e-428f-8eff-27506d5cc1df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:52.824636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4dca044-931e-428f-8eff-27506d5cc1df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:52.825069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4dca044-931e-428f-8eff-27506d5cc1df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:52.885695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a4dca044-931e-428f-8eff-27506d5cc1df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:52.893180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a4dca044-931e-428f-8eff-27506d5cc1df tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081428 May 24 13:26:52.893733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 800/1606] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:52 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:53.908794 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dd4a538f-bcb7-4a0a-886c-9be21077aea7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:53.909408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dd4a538f-bcb7-4a0a-886c-9be21077aea7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:53.916143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd4a538f-bcb7-4a0a-886c-9be21077aea7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:53.916584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd4a538f-bcb7-4a0a-886c-9be21077aea7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:53.917331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd4a538f-bcb7-4a0a-886c-9be21077aea7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:53.917765 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dd4a538f-bcb7-4a0a-886c-9be21077aea7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:53.977623 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-dd4a538f-bcb7-4a0a-886c-9be21077aea7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:53.985284 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dd4a538f-bcb7-4a0a-886c-9be21077aea7 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080320 May 24 13:26:53.985852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 807/1607] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:53 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:55.002171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1d9b9737-28ad-49d3-b597-7b3c6cd0d540 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:55.002828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1d9b9737-28ad-49d3-b597-7b3c6cd0d540 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:55.009445 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d9b9737-28ad-49d3-b597-7b3c6cd0d540 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:55.009894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d9b9737-28ad-49d3-b597-7b3c6cd0d540 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:55.010685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d9b9737-28ad-49d3-b597-7b3c6cd0d540 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:55.011120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d9b9737-28ad-49d3-b597-7b3c6cd0d540 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:55.070848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1d9b9737-28ad-49d3-b597-7b3c6cd0d540 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:55.078400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1d9b9737-28ad-49d3-b597-7b3c6cd0d540 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080054 May 24 13:26:55.079456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 801/1608] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:54 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:56.095944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1ebf8df3-233a-4c19-9cd2-aedf8c9c60ca tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:56.096567 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1ebf8df3-233a-4c19-9cd2-aedf8c9c60ca tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:56.103126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ebf8df3-233a-4c19-9cd2-aedf8c9c60ca tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:56.103576 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ebf8df3-233a-4c19-9cd2-aedf8c9c60ca tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:56.104333 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ebf8df3-233a-4c19-9cd2-aedf8c9c60ca tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:56.104788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1ebf8df3-233a-4c19-9cd2-aedf8c9c60ca tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:56.167859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1ebf8df3-233a-4c19-9cd2-aedf8c9c60ca tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:56.176010 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1ebf8df3-233a-4c19-9cd2-aedf8c9c60ca tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084477 May 24 13:26:56.176584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 808/1609] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:56 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:57.193488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f5d646e3-bc0e-425c-8d11-8fa0b36a7287 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:57.194100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f5d646e3-bc0e-425c-8d11-8fa0b36a7287 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:57.200808 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5d646e3-bc0e-425c-8d11-8fa0b36a7287 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:57.201260 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5d646e3-bc0e-425c-8d11-8fa0b36a7287 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:57.202029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5d646e3-bc0e-425c-8d11-8fa0b36a7287 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:57.202504 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5d646e3-bc0e-425c-8d11-8fa0b36a7287 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:57.206371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=84 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:26:57.262630 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f5d646e3-bc0e-425c-8d11-8fa0b36a7287 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:57.270074 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f5d646e3-bc0e-425c-8d11-8fa0b36a7287 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080453 May 24 13:26:57.270665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 802/1610] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:57 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:58.288446 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-59faecd8-e256-4ad5-a60c-8793276e94ab tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:58.289226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-59faecd8-e256-4ad5-a60c-8793276e94ab tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:58.295026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59faecd8-e256-4ad5-a60c-8793276e94ab tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:58.295484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59faecd8-e256-4ad5-a60c-8793276e94ab tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:58.296250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59faecd8-e256-4ad5-a60c-8793276e94ab tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:58.296692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59faecd8-e256-4ad5-a60c-8793276e94ab tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:58.356460 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-59faecd8-e256-4ad5-a60c-8793276e94ab tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:58.363968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-59faecd8-e256-4ad5-a60c-8793276e94ab tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080228 May 24 13:26:58.364534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 809/1611] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:58 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:26:59.381270 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7be60157-7fad-4e3e-a811-0fb148d401ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:26:59.381891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7be60157-7fad-4e3e-a811-0fb148d401ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:26:59.388364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7be60157-7fad-4e3e-a811-0fb148d401ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:59.388811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7be60157-7fad-4e3e-a811-0fb148d401ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:59.389564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7be60157-7fad-4e3e-a811-0fb148d401ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:26:59.389993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7be60157-7fad-4e3e-a811-0fb148d401ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:26:59.454316 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7be60157-7fad-4e3e-a811-0fb148d401ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:26:59.461741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7be60157-7fad-4e3e-a811-0fb148d401ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084357 May 24 13:26:59.462320 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 803/1612] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:26:59 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:00.478594 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-86eb996a-2b9e-470a-93a6-32517302b04a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:00.479215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-86eb996a-2b9e-470a-93a6-32517302b04a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:00.485928 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86eb996a-2b9e-470a-93a6-32517302b04a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:00.486406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86eb996a-2b9e-470a-93a6-32517302b04a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:00.487169 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86eb996a-2b9e-470a-93a6-32517302b04a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:00.487607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86eb996a-2b9e-470a-93a6-32517302b04a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:00.549137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-86eb996a-2b9e-470a-93a6-32517302b04a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:00.556516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-86eb996a-2b9e-470a-93a6-32517302b04a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081807 May 24 13:27:00.557071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 810/1613] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:00 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:01.572940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-336c027a-fb2a-417d-a632-2604a3bbf467 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:01.573549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-336c027a-fb2a-417d-a632-2604a3bbf467 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:01.580602 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-336c027a-fb2a-417d-a632-2604a3bbf467 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:01.581043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-336c027a-fb2a-417d-a632-2604a3bbf467 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:01.581796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-336c027a-fb2a-417d-a632-2604a3bbf467 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:01.582224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-336c027a-fb2a-417d-a632-2604a3bbf467 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:01.643112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-336c027a-fb2a-417d-a632-2604a3bbf467 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:01.650535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-336c027a-fb2a-417d-a632-2604a3bbf467 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081423 May 24 13:27:01.651087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 804/1614] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:01 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:02.666943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3fde3b0c-9205-43da-9127-1a489474400e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:02.667514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3fde3b0c-9205-43da-9127-1a489474400e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:02.674602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3fde3b0c-9205-43da-9127-1a489474400e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:02.676297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3fde3b0c-9205-43da-9127-1a489474400e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:02.677081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3fde3b0c-9205-43da-9127-1a489474400e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:02.677518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3fde3b0c-9205-43da-9127-1a489474400e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:02.740200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3fde3b0c-9205-43da-9127-1a489474400e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:02.747643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3fde3b0c-9205-43da-9127-1a489474400e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084734 May 24 13:27:02.748203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 811/1615] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:02 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:03.764517 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3efe012a-5a7f-4cec-8ff6-03431e12a557 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:03.765157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3efe012a-5a7f-4cec-8ff6-03431e12a557 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:03.772299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efe012a-5a7f-4cec-8ff6-03431e12a557 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:03.772747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efe012a-5a7f-4cec-8ff6-03431e12a557 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:03.773504 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efe012a-5a7f-4cec-8ff6-03431e12a557 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:03.773937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efe012a-5a7f-4cec-8ff6-03431e12a557 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:03.833293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3efe012a-5a7f-4cec-8ff6-03431e12a557 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:03.840860 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3efe012a-5a7f-4cec-8ff6-03431e12a557 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080353 May 24 13:27:03.841427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 805/1616] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:03 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:04.858485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-848b9f59-8e56-4578-bc84-18b2b39cdc18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:04.859113 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-848b9f59-8e56-4578-bc84-18b2b39cdc18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:04.865625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-848b9f59-8e56-4578-bc84-18b2b39cdc18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:04.866089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-848b9f59-8e56-4578-bc84-18b2b39cdc18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:04.866868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-848b9f59-8e56-4578-bc84-18b2b39cdc18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:04.867307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-848b9f59-8e56-4578-bc84-18b2b39cdc18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:04.931493 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-848b9f59-8e56-4578-bc84-18b2b39cdc18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:04.939001 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-848b9f59-8e56-4578-bc84-18b2b39cdc18 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.084714 May 24 13:27:04.939565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 812/1617] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:04 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:05.956434 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ae6f2007-92b4-4465-adad-5a604d7c4ebd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:05.957045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ae6f2007-92b4-4465-adad-5a604d7c4ebd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:05.963667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae6f2007-92b4-4465-adad-5a604d7c4ebd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:05.964118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae6f2007-92b4-4465-adad-5a604d7c4ebd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:05.964874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae6f2007-92b4-4465-adad-5a604d7c4ebd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:05.965311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae6f2007-92b4-4465-adad-5a604d7c4ebd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:06.025460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ae6f2007-92b4-4465-adad-5a604d7c4ebd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:06.033432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ae6f2007-92b4-4465-adad-5a604d7c4ebd tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081471 May 24 13:27:06.034009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 806/1618] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:05 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:07.050932 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-21243d4b-64e6-40d9-b1b5-283d7c0a2502 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:07.051531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-21243d4b-64e6-40d9-b1b5-283d7c0a2502 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:07.058044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-21243d4b-64e6-40d9-b1b5-283d7c0a2502 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:07.058530 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-21243d4b-64e6-40d9-b1b5-283d7c0a2502 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:07.059285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-21243d4b-64e6-40d9-b1b5-283d7c0a2502 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:07.059716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-21243d4b-64e6-40d9-b1b5-283d7c0a2502 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:07.118903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-21243d4b-64e6-40d9-b1b5-283d7c0a2502 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:07.126919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-21243d4b-64e6-40d9-b1b5-283d7c0a2502 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080445 May 24 13:27:07.127490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 813/1619] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:07 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:08.145068 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7b3c956d-6100-4941-9892-373299d24a08 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:08.145682 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7b3c956d-6100-4941-9892-373299d24a08 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:08.152374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b3c956d-6100-4941-9892-373299d24a08 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:08.152822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b3c956d-6100-4941-9892-373299d24a08 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:08.153593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b3c956d-6100-4941-9892-373299d24a08 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:08.154035 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b3c956d-6100-4941-9892-373299d24a08 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:08.216179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7b3c956d-6100-4941-9892-373299d24a08 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:08.223614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7b3c956d-6100-4941-9892-373299d24a08 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083756 May 24 13:27:08.224174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 807/1620] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:08 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:09.241707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-05155020-1814-4c47-bcde-3ad90a0e615c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:09.242345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-05155020-1814-4c47-bcde-3ad90a0e615c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:09.244688 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=28 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:27:09.250164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05155020-1814-4c47-bcde-3ad90a0e615c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:09.251225 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05155020-1814-4c47-bcde-3ad90a0e615c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:09.251997 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05155020-1814-4c47-bcde-3ad90a0e615c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:09.252433 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-05155020-1814-4c47-bcde-3ad90a0e615c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:09.311559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-05155020-1814-4c47-bcde-3ad90a0e615c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:09.319725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-05155020-1814-4c47-bcde-3ad90a0e615c tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081875 May 24 13:27:09.320287 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 814/1621] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:09 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:10.336566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c447401e-90b7-46da-8026-7989c1776a6e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:10.337184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c447401e-90b7-46da-8026-7989c1776a6e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:10.339515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=28 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:27:10.345476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c447401e-90b7-46da-8026-7989c1776a6e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:10.345925 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c447401e-90b7-46da-8026-7989c1776a6e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:10.346728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c447401e-90b7-46da-8026-7989c1776a6e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:10.347168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c447401e-90b7-46da-8026-7989c1776a6e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:10.407413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c447401e-90b7-46da-8026-7989c1776a6e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:10.414985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c447401e-90b7-46da-8026-7989c1776a6e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082306 May 24 13:27:10.415549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 808/1622] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:10 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:27:11.432390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6adf3b19-f18b-4cfb-b685-b77a9cc14e1b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:11.433004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6adf3b19-f18b-4cfb-b685-b77a9cc14e1b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:11.440105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6adf3b19-f18b-4cfb-b685-b77a9cc14e1b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:11.440559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6adf3b19-f18b-4cfb-b685-b77a9cc14e1b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:11.441305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6adf3b19-f18b-4cfb-b685-b77a9cc14e1b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:11.441736 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6adf3b19-f18b-4cfb-b685-b77a9cc14e1b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:11.500075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6adf3b19-f18b-4cfb-b685-b77a9cc14e1b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:11.508120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6adf3b19-f18b-4cfb-b685-b77a9cc14e1b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.079650 May 24 13:27:11.508687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 815/1623] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:11 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:12.525240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-71b85884-da5f-45b2-8e93-70d379c32728 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:12.525853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-71b85884-da5f-45b2-8e93-70d379c32728 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:12.533081 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71b85884-da5f-45b2-8e93-70d379c32728 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:12.533530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71b85884-da5f-45b2-8e93-70d379c32728 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:12.534278 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71b85884-da5f-45b2-8e93-70d379c32728 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:12.534729 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71b85884-da5f-45b2-8e93-70d379c32728 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:12.596349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-71b85884-da5f-45b2-8e93-70d379c32728 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:12.604110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-71b85884-da5f-45b2-8e93-70d379c32728 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083037 May 24 13:27:12.604613 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 809/1624] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:12 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:13.620846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2fe75868-59bc-46a9-bdba-371e77223023 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:13.621459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2fe75868-59bc-46a9-bdba-371e77223023 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:13.628471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fe75868-59bc-46a9-bdba-371e77223023 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:13.628914 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fe75868-59bc-46a9-bdba-371e77223023 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:13.629658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fe75868-59bc-46a9-bdba-371e77223023 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:13.630090 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2fe75868-59bc-46a9-bdba-371e77223023 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:13.692032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2fe75868-59bc-46a9-bdba-371e77223023 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:13.699434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2fe75868-59bc-46a9-bdba-371e77223023 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082469 May 24 13:27:13.699990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 816/1625] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:13 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:14.715286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e595b32-6b11-4845-9b46-7d962f3779ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:14.715849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e595b32-6b11-4845-9b46-7d962f3779ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:14.723175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e595b32-6b11-4845-9b46-7d962f3779ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:14.723621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e595b32-6b11-4845-9b46-7d962f3779ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:14.724372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e595b32-6b11-4845-9b46-7d962f3779ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:14.724800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e595b32-6b11-4845-9b46-7d962f3779ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:14.784530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e595b32-6b11-4845-9b46-7d962f3779ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:14.792541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e595b32-6b11-4845-9b46-7d962f3779ec tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081182 May 24 13:27:14.793096 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 810/1626] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:14 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:15.809602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e333aa08-bf54-4ea1-ad35-d0f5cffc6c3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:15.810164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e333aa08-bf54-4ea1-ad35-d0f5cffc6c3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:15.816602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e333aa08-bf54-4ea1-ad35-d0f5cffc6c3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:15.817045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e333aa08-bf54-4ea1-ad35-d0f5cffc6c3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:15.817797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e333aa08-bf54-4ea1-ad35-d0f5cffc6c3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:15.818226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e333aa08-bf54-4ea1-ad35-d0f5cffc6c3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:15.879123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e333aa08-bf54-4ea1-ad35-d0f5cffc6c3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:15.886321 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e333aa08-bf54-4ea1-ad35-d0f5cffc6c3a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080690 May 24 13:27:15.886880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 817/1627] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:15 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:16.903203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ba4025ee-2263-4e1a-971b-9a704d4a262a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:16.903810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ba4025ee-2263-4e1a-971b-9a704d4a262a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:16.910349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba4025ee-2263-4e1a-971b-9a704d4a262a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:16.910793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba4025ee-2263-4e1a-971b-9a704d4a262a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:16.911545 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba4025ee-2263-4e1a-971b-9a704d4a262a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:16.911977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba4025ee-2263-4e1a-971b-9a704d4a262a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:16.973573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ba4025ee-2263-4e1a-971b-9a704d4a262a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:16.981235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ba4025ee-2263-4e1a-971b-9a704d4a262a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081875 May 24 13:27:16.981779 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 811/1628] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:16 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:17.998752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1c0424df-e34f-4019-980e-9f7194df4a31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:17.999346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1c0424df-e34f-4019-980e-9f7194df4a31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:18.005707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c0424df-e34f-4019-980e-9f7194df4a31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:18.006147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c0424df-e34f-4019-980e-9f7194df4a31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:18.006941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c0424df-e34f-4019-980e-9f7194df4a31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:18.007369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1c0424df-e34f-4019-980e-9f7194df4a31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:18.068856 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1c0424df-e34f-4019-980e-9f7194df4a31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:18.076401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1c0424df-e34f-4019-980e-9f7194df4a31 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.081598 May 24 13:27:18.076960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 818/1629] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:17 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:19.093206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d6fa5fd-30a7-494c-8244-802bad5b101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:19.093872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d6fa5fd-30a7-494c-8244-802bad5b101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:19.099937 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d6fa5fd-30a7-494c-8244-802bad5b101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:19.100380 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d6fa5fd-30a7-494c-8244-802bad5b101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:19.101132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d6fa5fd-30a7-494c-8244-802bad5b101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:19.101563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d6fa5fd-30a7-494c-8244-802bad5b101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:19.160617 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d6fa5fd-30a7-494c-8244-802bad5b101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:19.168087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d6fa5fd-30a7-494c-8244-802bad5b101b tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.078919 May 24 13:27:19.168640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 812/1630] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:19 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:20.185580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2cc52219-83aa-4e77-b229-baa9e2ad9b3e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:20.186203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2cc52219-83aa-4e77-b229-baa9e2ad9b3e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:20.193338 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2cc52219-83aa-4e77-b229-baa9e2ad9b3e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:20.193800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2cc52219-83aa-4e77-b229-baa9e2ad9b3e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:20.194600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2cc52219-83aa-4e77-b229-baa9e2ad9b3e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:20.195045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2cc52219-83aa-4e77-b229-baa9e2ad9b3e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:20.254408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2cc52219-83aa-4e77-b229-baa9e2ad9b3e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:20.261809 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2cc52219-83aa-4e77-b229-baa9e2ad9b3e tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.080199 May 24 13:27:20.262392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 819/1631] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:20 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:21.279392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-10b28a4c-11ee-45d8-917c-d1957c1392f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:21.279998 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-10b28a4c-11ee-45d8-917c-d1957c1392f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:21.286489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b28a4c-11ee-45d8-917c-d1957c1392f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:21.286939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b28a4c-11ee-45d8-917c-d1957c1392f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:21.287700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b28a4c-11ee-45d8-917c-d1957c1392f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:21.288135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b28a4c-11ee-45d8-917c-d1957c1392f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:21.349802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-10b28a4c-11ee-45d8-917c-d1957c1392f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:21.357680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-10b28a4c-11ee-45d8-917c-d1957c1392f1 tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.082220 May 24 13:27:21.358241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 813/1632] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:21 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:22.374834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-07f12178-06b7-47c5-bd46-022720cadc5f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:22.378054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-07f12178-06b7-47c5-bd46-022720cadc5f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: a15306de-1c66-401f-ae12-53f104459b1c] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:22.386078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-07f12178-06b7-47c5-bd46-022720cadc5f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:22.386556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-07f12178-06b7-47c5-bd46-022720cadc5f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:22.387322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-07f12178-06b7-47c5-bd46-022720cadc5f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:22.387755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-07f12178-06b7-47c5-bd46-022720cadc5f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:22.390398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=84 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:27:22.450759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-07f12178-06b7-47c5-bd46-022720cadc5f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d9358c42a43fea94927869c44dc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20159be9d404dd2812ffeffe055ec67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:27:22.458168 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-07f12178-06b7-47c5-bd46-022720cadc5f tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c" status: 200 len: 1226 microversion: 2.1 time: 0.087171 May 24 13:27:22.458752 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 820/1633] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:22 2022] GET /compute/v2.1/servers/a15306de-1c66-401f-ae12-53f104459b1c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:27:22.894513 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:22.895050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:22.901482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:22.901872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:22.902650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:22.903087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:22.916425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] HTTP exception thrown: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Request method failure captured: May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad HTTP/1.1 May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNeReOM_br9UiPR5uoCJody7sTzygLqdP-JwtVLzv2boMJgONbvTLDZqoV35BfGVyU-T1eRQTzVLUR0I1Tk1GPiTHgFbDUI0p1fuItXpuUAlWXzmjZyV35AwOk6bmoMy9igZIIF6iZEcXg_tm6dmmeLqEMgZKcHLKifoxhK05-hOW-o May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: b20159be9d404dd2812ffeffe055ec67 May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-TestVolumeBootPattern-1193829736 May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:27:22.918054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-TestVolumeBootPattern-1193829736 May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: b20159be9d404dd2812ffeffe055ec67 May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1193829736 May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-TestVolumeBootPattern-1193829736-project May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: d87d9358c42a43fea94927869c44dc82 May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-TestVolumeBootPattern-1193829736-project May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.919895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '0868aa59-60f0-4ee6-8f6a-e58671fc79ad'} May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:27:22.920810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.922237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:27:22.923770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Returning 404 to user: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:27:22.923770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-69717b8f-1718-4954-9b7e-2f9b758dd09a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 404 len: 111 microversion: 2.1 time: 0.029535 May 24 13:27:22.923770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 814/1634] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:27:22 2022] DELETE /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:27:22.927999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:27:22.928626 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] [instance: 0868aa59-60f0-4ee6-8f6a-e58671fc79ad] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:27:22.934672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:22.935130 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:22.935904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:27:22.936343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:27:22.949350 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] HTTP exception thrown: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Request method failure captured: May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad HTTP/1.1 May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNeReOM_br9UiPR5uoCJody7sTzygLqdP-JwtVLzv2boMJgONbvTLDZqoV35BfGVyU-T1eRQTzVLUR0I1Tk1GPiTHgFbDUI0p1fuItXpuUAlWXzmjZyV35AwOk6bmoMy9igZIIF6iZEcXg_tm6dmmeLqEMgZKcHLKifoxhK05-hOW-o May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: b20159be9d404dd2812ffeffe055ec67 May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-TestVolumeBootPattern-1193829736 May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:27:22.951037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b20159be9d404dd2812ffeffe055ec67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-TestVolumeBootPattern-1193829736 May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: b20159be9d404dd2812ffeffe055ec67 May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-TestVolumeBootPattern-1193829736 May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-TestVolumeBootPattern-1193829736-project May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: d87d9358c42a43fea94927869c44dc82 May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-TestVolumeBootPattern-1193829736-project May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.952678 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '0868aa59-60f0-4ee6-8f6a-e58671fc79ad'} May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:27:22.954317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. May 24 13:27:22.955994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:27:22.957429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Returning 404 to user: Instance 0868aa59-60f0-4ee6-8f6a-e58671fc79ad could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:27:22.957429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-08992407-f18b-40e7-975b-c3e8cb95a4ac tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad" status: 404 len: 111 microversion: 2.1 time: 0.028344 May 24 13:27:22.957429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 821/1635] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:27:22 2022] GET /compute/v2.1/servers/0868aa59-60f0-4ee6-8f6a-e58671fc79ad => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:28:40.013958 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:28:40.014841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:28:43.715132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:28:43.715733 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:28:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:29:07.806548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:29:07.807139 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:29:24.412368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41c46349-b9d7-4e27-abfc-1423f374e67f] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 13:29:24.412961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=13 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:29:24.413895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=73 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:29:24.418717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-668ae2ad-32f4-4633-b549-85d0b5e7712c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:24.419650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-668ae2ad-32f4-4633-b549-85d0b5e7712c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:24.427503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-668ae2ad-32f4-4633-b549-85d0b5e7712c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:24.427958 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-668ae2ad-32f4-4633-b549-85d0b5e7712c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:24.428732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-668ae2ad-32f4-4633-b549-85d0b5e7712c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:24.429177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-668ae2ad-32f4-4633-b549-85d0b5e7712c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:24.460120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-668ae2ad-32f4-4633-b549-85d0b5e7712c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050034 May 24 13:29:24.460671 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 815/1636] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:29:25.470272 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1edc446e-99a8-47f5-83a1-692a07eca1d0] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 13:29:25.471109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=15 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:29:25.471843 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=7 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:29:25.476248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-01da8f1c-fb2e-453f-b3e6-73ec43548624 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:25.477226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-01da8f1c-fb2e-453f-b3e6-73ec43548624 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:25.485166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-01da8f1c-fb2e-453f-b3e6-73ec43548624 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:25.485625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-01da8f1c-fb2e-453f-b3e6-73ec43548624 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:25.486499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-01da8f1c-fb2e-453f-b3e6-73ec43548624 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:25.486945 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-01da8f1c-fb2e-453f-b3e6-73ec43548624 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:25.516190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-01da8f1c-fb2e-453f-b3e6-73ec43548624 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048182 May 24 13:29:25.516735 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 822/1637] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:26.527710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e11856a8-f1e0-4f12-9d43-c0e6a4c7b0d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:26.528624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e11856a8-f1e0-4f12-9d43-c0e6a4c7b0d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:26.536375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e11856a8-f1e0-4f12-9d43-c0e6a4c7b0d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:26.536819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e11856a8-f1e0-4f12-9d43-c0e6a4c7b0d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:26.537583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e11856a8-f1e0-4f12-9d43-c0e6a4c7b0d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:26.538015 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e11856a8-f1e0-4f12-9d43-c0e6a4c7b0d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:26.556253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] [41c46349-b9d7-4e27-abfc-1423f374e67f] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40528. May 24 13:29:26.574513 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e11856a8-f1e0-4f12-9d43-c0e6a4c7b0d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050709 May 24 13:29:26.575066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 816/1638] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:27.586537 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e1e6c406-4cbf-4723-9189-c20a68d4af9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:27.587467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e1e6c406-4cbf-4723-9189-c20a68d4af9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:27.596566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1e6c406-4cbf-4723-9189-c20a68d4af9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:27.597013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1e6c406-4cbf-4723-9189-c20a68d4af9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:27.597775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1e6c406-4cbf-4723-9189-c20a68d4af9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:27.598211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1e6c406-4cbf-4723-9189-c20a68d4af9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:27.604048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] [1edc446e-99a8-47f5-83a1-692a07eca1d0] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40532. May 24 13:29:27.629179 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e1e6c406-4cbf-4723-9189-c20a68d4af9e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046603 May 24 13:29:27.629724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 823/1639] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:28.640861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-54c624d3-8217-42bc-981f-74be532b25e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:28.641773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-54c624d3-8217-42bc-981f-74be532b25e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:28.648238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54c624d3-8217-42bc-981f-74be532b25e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:28.648690 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54c624d3-8217-42bc-981f-74be532b25e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:28.649446 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54c624d3-8217-42bc-981f-74be532b25e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:28.649875 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54c624d3-8217-42bc-981f-74be532b25e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:28.678445 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-54c624d3-8217-42bc-981f-74be532b25e2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041539 May 24 13:29:28.678916 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 817/1640] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:29.690634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-035761e1-5b78-4e11-9ade-e7584bab72a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:29.691484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-035761e1-5b78-4e11-9ade-e7584bab72a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:29.697933 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-035761e1-5b78-4e11-9ade-e7584bab72a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:29.698412 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-035761e1-5b78-4e11-9ade-e7584bab72a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:29.699171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-035761e1-5b78-4e11-9ade-e7584bab72a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:29.699608 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-035761e1-5b78-4e11-9ade-e7584bab72a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:29.728844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-035761e1-5b78-4e11-9ade-e7584bab72a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042938 May 24 13:29:29.729388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 824/1641] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:30.740971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5f392a1d-abae-4082-a74f-617a76a904f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:30.741832 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5f392a1d-abae-4082-a74f-617a76a904f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:30.748252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f392a1d-abae-4082-a74f-617a76a904f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:30.748694 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f392a1d-abae-4082-a74f-617a76a904f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:30.749443 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f392a1d-abae-4082-a74f-617a76a904f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:30.749873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f392a1d-abae-4082-a74f-617a76a904f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:30.779295 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5f392a1d-abae-4082-a74f-617a76a904f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042331 May 24 13:29:30.779825 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 818/1642] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:31.791387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-62c961e2-f682-4750-b8d1-bee05ba10c63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:31.792247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-62c961e2-f682-4750-b8d1-bee05ba10c63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:31.798707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62c961e2-f682-4750-b8d1-bee05ba10c63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:31.799151 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62c961e2-f682-4750-b8d1-bee05ba10c63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:31.799901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62c961e2-f682-4750-b8d1-bee05ba10c63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:31.800329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62c961e2-f682-4750-b8d1-bee05ba10c63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:31.829039 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-62c961e2-f682-4750-b8d1-bee05ba10c63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041696 May 24 13:29:31.829576 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 825/1643] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:32.840555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-081d07bd-604e-4432-b7e2-2e243fb93698 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:32.841470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-081d07bd-604e-4432-b7e2-2e243fb93698 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:32.852995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-081d07bd-604e-4432-b7e2-2e243fb93698 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:32.854324 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-081d07bd-604e-4432-b7e2-2e243fb93698 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:32.855676 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-081d07bd-604e-4432-b7e2-2e243fb93698 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:32.856118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-081d07bd-604e-4432-b7e2-2e243fb93698 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:32.886577 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-081d07bd-604e-4432-b7e2-2e243fb93698 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049932 May 24 13:29:32.887118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 819/1644] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:33.897064 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e03af19c-9ddf-4831-a2ef-003fcad4b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:33.897992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e03af19c-9ddf-4831-a2ef-003fcad4b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:33.904482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e03af19c-9ddf-4831-a2ef-003fcad4b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:33.904937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e03af19c-9ddf-4831-a2ef-003fcad4b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:33.905705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e03af19c-9ddf-4831-a2ef-003fcad4b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:33.906144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e03af19c-9ddf-4831-a2ef-003fcad4b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:33.936524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e03af19c-9ddf-4831-a2ef-003fcad4b71b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043480 May 24 13:29:33.937073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 826/1645] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:34.948685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-96c99ad2-f7ef-405c-ab13-22788108de30 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:34.949633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-96c99ad2-f7ef-405c-ab13-22788108de30 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:34.956208 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96c99ad2-f7ef-405c-ab13-22788108de30 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:34.956761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96c99ad2-f7ef-405c-ab13-22788108de30 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:34.957478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96c99ad2-f7ef-405c-ab13-22788108de30 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:34.957914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96c99ad2-f7ef-405c-ab13-22788108de30 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:34.987583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-96c99ad2-f7ef-405c-ab13-22788108de30 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042880 May 24 13:29:34.988122 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 820/1646] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:35.999609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-633f0c6a-86ad-4eea-a8ca-d9b8d4e7d452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:36.001028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-633f0c6a-86ad-4eea-a8ca-d9b8d4e7d452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:36.007513 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-633f0c6a-86ad-4eea-a8ca-d9b8d4e7d452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:36.007964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-633f0c6a-86ad-4eea-a8ca-d9b8d4e7d452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:36.008716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-633f0c6a-86ad-4eea-a8ca-d9b8d4e7d452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:36.009149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-633f0c6a-86ad-4eea-a8ca-d9b8d4e7d452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:36.038085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-633f0c6a-86ad-4eea-a8ca-d9b8d4e7d452 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042438 May 24 13:29:36.038656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 827/1647] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:37.049750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7066317b-c01c-4d8e-bb64-49ba9175cee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:37.051383 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7066317b-c01c-4d8e-bb64-49ba9175cee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:37.058398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7066317b-c01c-4d8e-bb64-49ba9175cee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:37.059031 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7066317b-c01c-4d8e-bb64-49ba9175cee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:37.059794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7066317b-c01c-4d8e-bb64-49ba9175cee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:37.060254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7066317b-c01c-4d8e-bb64-49ba9175cee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:37.092240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7066317b-c01c-4d8e-bb64-49ba9175cee5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046518 May 24 13:29:37.092794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 821/1648] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:38.104888 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c9b48c12-ee98-413e-9e8b-61ce4ee9ff1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:38.105818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c9b48c12-ee98-413e-9e8b-61ce4ee9ff1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:38.112966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9b48c12-ee98-413e-9e8b-61ce4ee9ff1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:38.113418 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9b48c12-ee98-413e-9e8b-61ce4ee9ff1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:38.114181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9b48c12-ee98-413e-9e8b-61ce4ee9ff1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:38.114646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c9b48c12-ee98-413e-9e8b-61ce4ee9ff1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:38.143050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c9b48c12-ee98-413e-9e8b-61ce4ee9ff1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042439 May 24 13:29:38.143602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 828/1649] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:39.154758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-610ea265-0fda-4cf9-a8b8-c141bbfcafec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:39.155692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-610ea265-0fda-4cf9-a8b8-c141bbfcafec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:39.162130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-610ea265-0fda-4cf9-a8b8-c141bbfcafec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:39.162627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-610ea265-0fda-4cf9-a8b8-c141bbfcafec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:39.163395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-610ea265-0fda-4cf9-a8b8-c141bbfcafec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:39.163837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-610ea265-0fda-4cf9-a8b8-c141bbfcafec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:39.194568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-610ea265-0fda-4cf9-a8b8-c141bbfcafec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043842 May 24 13:29:39.195114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 822/1650] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:40.206803 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-838bb3b2-49d2-4f7c-85d9-31c0a14a61ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:40.207737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-838bb3b2-49d2-4f7c-85d9-31c0a14a61ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:40.214246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-838bb3b2-49d2-4f7c-85d9-31c0a14a61ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:40.214737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-838bb3b2-49d2-4f7c-85d9-31c0a14a61ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:40.215506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-838bb3b2-49d2-4f7c-85d9-31c0a14a61ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:40.215951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-838bb3b2-49d2-4f7c-85d9-31c0a14a61ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:40.245066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-838bb3b2-49d2-4f7c-85d9-31c0a14a61ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042945 May 24 13:29:40.245623 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 829/1651] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:29:41.256922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a4693968-ed21-4dcf-9dd1-134454259a33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:41.257873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a4693968-ed21-4dcf-9dd1-134454259a33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:41.264340 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4693968-ed21-4dcf-9dd1-134454259a33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:41.264785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4693968-ed21-4dcf-9dd1-134454259a33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:41.265576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4693968-ed21-4dcf-9dd1-134454259a33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:41.266004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4693968-ed21-4dcf-9dd1-134454259a33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:41.294448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a4693968-ed21-4dcf-9dd1-134454259a33 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041523 May 24 13:29:41.294976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 823/1652] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:42.306684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2f95abb4-3cb2-47a2-9d52-f2d095e5ab5e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:42.307611 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2f95abb4-3cb2-47a2-9d52-f2d095e5ab5e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:42.314725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f95abb4-3cb2-47a2-9d52-f2d095e5ab5e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:42.315175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f95abb4-3cb2-47a2-9d52-f2d095e5ab5e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:42.315930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f95abb4-3cb2-47a2-9d52-f2d095e5ab5e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:42.316370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f95abb4-3cb2-47a2-9d52-f2d095e5ab5e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:42.344553 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2f95abb4-3cb2-47a2-9d52-f2d095e5ab5e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041909 May 24 13:29:42.345092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 830/1653] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:43.356600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2df3f496-07e9-4c19-9388-24e21423654a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:43.357515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2df3f496-07e9-4c19-9388-24e21423654a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:43.363967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2df3f496-07e9-4c19-9388-24e21423654a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:43.364416 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2df3f496-07e9-4c19-9388-24e21423654a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:43.365166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2df3f496-07e9-4c19-9388-24e21423654a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:43.365598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2df3f496-07e9-4c19-9388-24e21423654a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:43.395292 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2df3f496-07e9-4c19-9388-24e21423654a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042871 May 24 13:29:43.395933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 824/1654] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:44.407466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-25272678-c0a3-4e11-b84d-1e999f66d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:44.408392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-25272678-c0a3-4e11-b84d-1e999f66d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:44.415237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-25272678-c0a3-4e11-b84d-1e999f66d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:44.415684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-25272678-c0a3-4e11-b84d-1e999f66d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:44.416443 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-25272678-c0a3-4e11-b84d-1e999f66d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:44.416876 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-25272678-c0a3-4e11-b84d-1e999f66d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:44.445818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-25272678-c0a3-4e11-b84d-1e999f66d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042872 May 24 13:29:44.446388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 831/1655] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:45.457403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-92fae8cb-2125-4f6e-86c0-15790de92f75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:45.458371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-92fae8cb-2125-4f6e-86c0-15790de92f75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:45.464867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92fae8cb-2125-4f6e-86c0-15790de92f75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:45.465317 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92fae8cb-2125-4f6e-86c0-15790de92f75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:45.466066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92fae8cb-2125-4f6e-86c0-15790de92f75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:45.466521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-92fae8cb-2125-4f6e-86c0-15790de92f75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:45.497079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-92fae8cb-2125-4f6e-86c0-15790de92f75 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043702 May 24 13:29:45.497627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 825/1656] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:46.508565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-94be7735-7d12-4bc6-a269-200ff8c7d773 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:46.509544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-94be7735-7d12-4bc6-a269-200ff8c7d773 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:46.516663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94be7735-7d12-4bc6-a269-200ff8c7d773 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:46.517109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94be7735-7d12-4bc6-a269-200ff8c7d773 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:46.517858 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94be7735-7d12-4bc6-a269-200ff8c7d773 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:46.518312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-94be7735-7d12-4bc6-a269-200ff8c7d773 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:46.546467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-94be7735-7d12-4bc6-a269-200ff8c7d773 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041822 May 24 13:29:46.547510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 832/1657] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:47.558511 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dcdef3e8-a3e4-4682-a849-b17f3b4df55a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:47.559458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dcdef3e8-a3e4-4682-a849-b17f3b4df55a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:47.565879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcdef3e8-a3e4-4682-a849-b17f3b4df55a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:47.566413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcdef3e8-a3e4-4682-a849-b17f3b4df55a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:47.567170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcdef3e8-a3e4-4682-a849-b17f3b4df55a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:47.567600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcdef3e8-a3e4-4682-a849-b17f3b4df55a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:47.596905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dcdef3e8-a3e4-4682-a849-b17f3b4df55a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042360 May 24 13:29:47.597445 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 826/1658] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:48.608522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-45e34de9-7f0a-4e9d-aa17-705e51076110 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:48.610166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-45e34de9-7f0a-4e9d-aa17-705e51076110 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:48.616572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-45e34de9-7f0a-4e9d-aa17-705e51076110 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:48.617014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-45e34de9-7f0a-4e9d-aa17-705e51076110 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:48.617763 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-45e34de9-7f0a-4e9d-aa17-705e51076110 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:48.618191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-45e34de9-7f0a-4e9d-aa17-705e51076110 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:48.646432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-45e34de9-7f0a-4e9d-aa17-705e51076110 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041878 May 24 13:29:48.646968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 833/1659] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:49.657872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b8257161-747d-4a05-a3ec-104c105e1c76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:49.658754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b8257161-747d-4a05-a3ec-104c105e1c76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:49.665216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8257161-747d-4a05-a3ec-104c105e1c76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:49.665668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8257161-747d-4a05-a3ec-104c105e1c76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:49.666464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8257161-747d-4a05-a3ec-104c105e1c76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:49.666902 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b8257161-747d-4a05-a3ec-104c105e1c76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:49.695960 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b8257161-747d-4a05-a3ec-104c105e1c76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042736 May 24 13:29:49.696498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 827/1660] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:50.708107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-028d37c5-7c1e-4da3-90f1-24103e9f9b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:50.708986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-028d37c5-7c1e-4da3-90f1-24103e9f9b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:50.715449 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-028d37c5-7c1e-4da3-90f1-24103e9f9b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:50.715895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-028d37c5-7c1e-4da3-90f1-24103e9f9b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:50.716647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-028d37c5-7c1e-4da3-90f1-24103e9f9b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:50.717077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-028d37c5-7c1e-4da3-90f1-24103e9f9b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:50.745534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-028d37c5-7c1e-4da3-90f1-24103e9f9b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042067 May 24 13:29:50.746076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 834/1661] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:51.757322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8469d3c4-768b-457b-b955-acd749d052ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:51.758152 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8469d3c4-768b-457b-b955-acd749d052ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:51.764680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8469d3c4-768b-457b-b955-acd749d052ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:51.765127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8469d3c4-768b-457b-b955-acd749d052ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:51.765885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8469d3c4-768b-457b-b955-acd749d052ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:51.766344 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8469d3c4-768b-457b-b955-acd749d052ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:51.795066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8469d3c4-768b-457b-b955-acd749d052ca tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041827 May 24 13:29:51.795605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 828/1662] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:52.806959 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-517270b6-e5a4-4bad-926d-6766df153544 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:52.807808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-517270b6-e5a4-4bad-926d-6766df153544 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:52.815007 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-517270b6-e5a4-4bad-926d-6766df153544 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:52.815458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-517270b6-e5a4-4bad-926d-6766df153544 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:52.816215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-517270b6-e5a4-4bad-926d-6766df153544 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:52.816654 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-517270b6-e5a4-4bad-926d-6766df153544 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:52.845224 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-517270b6-e5a4-4bad-926d-6766df153544 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042285 May 24 13:29:52.845765 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 835/1663] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:53.857010 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-04b4fab3-c78f-4432-8aeb-926a93422902 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:53.857933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-04b4fab3-c78f-4432-8aeb-926a93422902 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:53.865032 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04b4fab3-c78f-4432-8aeb-926a93422902 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:53.865478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04b4fab3-c78f-4432-8aeb-926a93422902 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:53.866233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04b4fab3-c78f-4432-8aeb-926a93422902 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:53.866694 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04b4fab3-c78f-4432-8aeb-926a93422902 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:53.894835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-04b4fab3-c78f-4432-8aeb-926a93422902 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041822 May 24 13:29:53.895376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 829/1664] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:54.906306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7c715e42-318b-45cd-adf1-d6d82d6b886e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:54.907277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7c715e42-318b-45cd-adf1-d6d82d6b886e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:54.913715 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c715e42-318b-45cd-adf1-d6d82d6b886e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:54.914166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c715e42-318b-45cd-adf1-d6d82d6b886e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:54.914960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c715e42-318b-45cd-adf1-d6d82d6b886e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:54.915433 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7c715e42-318b-45cd-adf1-d6d82d6b886e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:54.948681 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7c715e42-318b-45cd-adf1-d6d82d6b886e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046340 May 24 13:29:54.949237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 836/1665] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:55.960741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-12548ba7-b1bc-4c17-a360-e3b2d04653da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:55.961574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-12548ba7-b1bc-4c17-a360-e3b2d04653da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:55.964019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=31 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:29:55.970004 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-12548ba7-b1bc-4c17-a360-e3b2d04653da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:55.970482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-12548ba7-b1bc-4c17-a360-e3b2d04653da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:55.971246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-12548ba7-b1bc-4c17-a360-e3b2d04653da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:55.971682 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-12548ba7-b1bc-4c17-a360-e3b2d04653da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:55.975403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=91 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:29:56.002944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-12548ba7-b1bc-4c17-a360-e3b2d04653da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046237 May 24 13:29:56.003498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 830/1666] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:57.014605 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cee7c4cd-ebad-4202-9239-892f6ee5bd7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:57.016145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cee7c4cd-ebad-4202-9239-892f6ee5bd7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:57.018527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=31 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:29:57.023988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cee7c4cd-ebad-4202-9239-892f6ee5bd7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:57.024437 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cee7c4cd-ebad-4202-9239-892f6ee5bd7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:57.025195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cee7c4cd-ebad-4202-9239-892f6ee5bd7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:57.025631 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cee7c4cd-ebad-4202-9239-892f6ee5bd7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:57.029366 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=91 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:29:57.056383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cee7c4cd-ebad-4202-9239-892f6ee5bd7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045623 May 24 13:29:57.057032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 837/1667] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:58.068766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d854f153-a35b-46d9-975f-fdb6e3280f3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:58.069707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d854f153-a35b-46d9-975f-fdb6e3280f3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:58.075707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d854f153-a35b-46d9-975f-fdb6e3280f3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:58.076147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d854f153-a35b-46d9-975f-fdb6e3280f3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:58.076923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d854f153-a35b-46d9-975f-fdb6e3280f3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:58.077355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d854f153-a35b-46d9-975f-fdb6e3280f3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:58.106665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d854f153-a35b-46d9-975f-fdb6e3280f3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041994 May 24 13:29:58.107198 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 831/1668] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:58 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:29:59.118341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1a781037-d007-4af2-956b-0876cc578bad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:29:59.119319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1a781037-d007-4af2-956b-0876cc578bad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:29:59.125408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1a781037-d007-4af2-956b-0876cc578bad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:59.125865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1a781037-d007-4af2-956b-0876cc578bad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:59.126656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1a781037-d007-4af2-956b-0876cc578bad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:29:59.127100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1a781037-d007-4af2-956b-0876cc578bad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:29:59.156879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1a781037-d007-4af2-956b-0876cc578bad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042666 May 24 13:29:59.157443 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 838/1669] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:29:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:00.169289 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e56d16c1-b294-41d1-8c25-3fe825bd6694 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:00.170236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e56d16c1-b294-41d1-8c25-3fe825bd6694 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:00.176612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e56d16c1-b294-41d1-8c25-3fe825bd6694 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:00.177055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e56d16c1-b294-41d1-8c25-3fe825bd6694 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:00.177817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e56d16c1-b294-41d1-8c25-3fe825bd6694 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:00.178248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e56d16c1-b294-41d1-8c25-3fe825bd6694 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:00.206884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e56d16c1-b294-41d1-8c25-3fe825bd6694 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042369 May 24 13:30:00.207427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 832/1670] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:00.706891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:30:00.707103 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:30:00.938910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:30:00.939098 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:30:01.218830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4388918c-5950-49b3-b4fd-a782deaef917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:01.220006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4388918c-5950-49b3-b4fd-a782deaef917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:01.227855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4388918c-5950-49b3-b4fd-a782deaef917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:01.228338 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4388918c-5950-49b3-b4fd-a782deaef917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:01.229236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4388918c-5950-49b3-b4fd-a782deaef917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:01.229669 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4388918c-5950-49b3-b4fd-a782deaef917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:01.268975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4388918c-5950-49b3-b4fd-a782deaef917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054211 May 24 13:30:01.269568 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 839/1671] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:02.280971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bcdf6ab0-656e-4ac7-ac16-55d33fa01a08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:02.282405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bcdf6ab0-656e-4ac7-ac16-55d33fa01a08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:02.288964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcdf6ab0-656e-4ac7-ac16-55d33fa01a08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:02.289407 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcdf6ab0-656e-4ac7-ac16-55d33fa01a08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:02.290170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcdf6ab0-656e-4ac7-ac16-55d33fa01a08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:02.290634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcdf6ab0-656e-4ac7-ac16-55d33fa01a08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:02.319455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bcdf6ab0-656e-4ac7-ac16-55d33fa01a08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042523 May 24 13:30:02.320001 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 833/1672] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:03.331066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-00128162-73a3-4221-9e7a-a6d03a8bfbf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:03.332004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-00128162-73a3-4221-9e7a-a6d03a8bfbf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:03.338565 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-00128162-73a3-4221-9e7a-a6d03a8bfbf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:03.339023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-00128162-73a3-4221-9e7a-a6d03a8bfbf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:03.339791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-00128162-73a3-4221-9e7a-a6d03a8bfbf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:03.340235 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-00128162-73a3-4221-9e7a-a6d03a8bfbf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:03.369471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-00128162-73a3-4221-9e7a-a6d03a8bfbf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042386 May 24 13:30:03.370014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 840/1673] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:04.380744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6476749c-19a7-44d6-a918-267157b52951 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:04.381648 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6476749c-19a7-44d6-a918-267157b52951 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:04.388285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6476749c-19a7-44d6-a918-267157b52951 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:04.388736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6476749c-19a7-44d6-a918-267157b52951 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:04.389508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6476749c-19a7-44d6-a918-267157b52951 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:04.389948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6476749c-19a7-44d6-a918-267157b52951 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:04.419168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6476749c-19a7-44d6-a918-267157b52951 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042422 May 24 13:30:04.419711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 834/1674] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:05.431313 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d4b01a05-acd7-4935-8b5a-089ba6e1a9b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:05.432250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d4b01a05-acd7-4935-8b5a-089ba6e1a9b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:05.439345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4b01a05-acd7-4935-8b5a-089ba6e1a9b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:05.439798 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4b01a05-acd7-4935-8b5a-089ba6e1a9b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:05.440562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4b01a05-acd7-4935-8b5a-089ba6e1a9b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:05.441004 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d4b01a05-acd7-4935-8b5a-089ba6e1a9b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:05.469600 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d4b01a05-acd7-4935-8b5a-089ba6e1a9b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042254 May 24 13:30:05.470149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 841/1675] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:06.481302 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c346b5e5-e4b6-4557-b3c7-e26d6388dc57 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:06.482228 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c346b5e5-e4b6-4557-b3c7-e26d6388dc57 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:06.488921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c346b5e5-e4b6-4557-b3c7-e26d6388dc57 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:06.491353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c346b5e5-e4b6-4557-b3c7-e26d6388dc57 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:06.492151 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c346b5e5-e4b6-4557-b3c7-e26d6388dc57 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:06.492596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c346b5e5-e4b6-4557-b3c7-e26d6388dc57 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:06.525980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c346b5e5-e4b6-4557-b3c7-e26d6388dc57 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048841 May 24 13:30:06.526571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 835/1676] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:07.537755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-381bade3-ce36-4485-9224-6da34d11ccf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:07.538760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-381bade3-ce36-4485-9224-6da34d11ccf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:07.545299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-381bade3-ce36-4485-9224-6da34d11ccf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:07.545755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-381bade3-ce36-4485-9224-6da34d11ccf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:07.546549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-381bade3-ce36-4485-9224-6da34d11ccf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:07.546988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-381bade3-ce36-4485-9224-6da34d11ccf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:07.575378 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-381bade3-ce36-4485-9224-6da34d11ccf7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041589 May 24 13:30:07.575928 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 842/1677] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:08.587350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-57dbb750-a285-4665-9dcc-98636c0d5aa3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:08.588265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-57dbb750-a285-4665-9dcc-98636c0d5aa3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:08.595166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57dbb750-a285-4665-9dcc-98636c0d5aa3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:08.595618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57dbb750-a285-4665-9dcc-98636c0d5aa3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:08.596375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57dbb750-a285-4665-9dcc-98636c0d5aa3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:08.596810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57dbb750-a285-4665-9dcc-98636c0d5aa3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:08.627325 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-57dbb750-a285-4665-9dcc-98636c0d5aa3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043889 May 24 13:30:08.627870 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 836/1678] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:09.638886 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-679eaca3-f7cd-4640-b003-5a27352cb1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:09.639810 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-679eaca3-f7cd-4640-b003-5a27352cb1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:09.647077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-679eaca3-f7cd-4640-b003-5a27352cb1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:09.647527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-679eaca3-f7cd-4640-b003-5a27352cb1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:09.648277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-679eaca3-f7cd-4640-b003-5a27352cb1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:09.648711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-679eaca3-f7cd-4640-b003-5a27352cb1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:09.677167 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-679eaca3-f7cd-4640-b003-5a27352cb1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042150 May 24 13:30:09.677646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 843/1679] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:10.296203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:30:10.296461 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:30:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:30:10.688742 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-30adddcd-c02b-40ce-a77e-5161032b4ed8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:10.689675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-30adddcd-c02b-40ce-a77e-5161032b4ed8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:10.696204 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30adddcd-c02b-40ce-a77e-5161032b4ed8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:10.696660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30adddcd-c02b-40ce-a77e-5161032b4ed8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:10.697424 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30adddcd-c02b-40ce-a77e-5161032b4ed8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:10.697861 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30adddcd-c02b-40ce-a77e-5161032b4ed8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:10.728614 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-30adddcd-c02b-40ce-a77e-5161032b4ed8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043905 May 24 13:30:10.729179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 837/1680] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:11.740340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c6390d01-2d38-425b-b0a0-966e0529f7c9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:11.741193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c6390d01-2d38-425b-b0a0-966e0529f7c9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:11.747742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6390d01-2d38-425b-b0a0-966e0529f7c9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:11.748197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6390d01-2d38-425b-b0a0-966e0529f7c9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:11.748960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6390d01-2d38-425b-b0a0-966e0529f7c9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:11.749413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c6390d01-2d38-425b-b0a0-966e0529f7c9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:11.779453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c6390d01-2d38-425b-b0a0-966e0529f7c9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043158 May 24 13:30:11.779998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 844/1681] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:12.790318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5f48c372-3bea-4f16-9b36-c693d33dcdc6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:12.791173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5f48c372-3bea-4f16-9b36-c693d33dcdc6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:12.798456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f48c372-3bea-4f16-9b36-c693d33dcdc6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:12.798902 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f48c372-3bea-4f16-9b36-c693d33dcdc6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:12.799659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f48c372-3bea-4f16-9b36-c693d33dcdc6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:12.800092 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f48c372-3bea-4f16-9b36-c693d33dcdc6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:12.828930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5f48c372-3bea-4f16-9b36-c693d33dcdc6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042704 May 24 13:30:12.829469 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 838/1682] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:13.840517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7f9a846c-96b2-4865-aa86-28df88a37845 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:13.841468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7f9a846c-96b2-4865-aa86-28df88a37845 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:13.849936 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f9a846c-96b2-4865-aa86-28df88a37845 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:13.850419 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f9a846c-96b2-4865-aa86-28df88a37845 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:13.851429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f9a846c-96b2-4865-aa86-28df88a37845 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:13.852320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7f9a846c-96b2-4865-aa86-28df88a37845 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:13.885799 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7f9a846c-96b2-4865-aa86-28df88a37845 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049219 May 24 13:30:13.886375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 845/1683] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:14.897627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d3b8a9cc-c721-4b2f-a5ca-7c4cfa6292e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:14.898566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3b8a9cc-c721-4b2f-a5ca-7c4cfa6292e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:14.904967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3b8a9cc-c721-4b2f-a5ca-7c4cfa6292e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:14.905408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3b8a9cc-c721-4b2f-a5ca-7c4cfa6292e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:14.906700 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3b8a9cc-c721-4b2f-a5ca-7c4cfa6292e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:14.907138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3b8a9cc-c721-4b2f-a5ca-7c4cfa6292e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:14.935634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d3b8a9cc-c721-4b2f-a5ca-7c4cfa6292e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042064 May 24 13:30:14.936162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 839/1684] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:15.947298 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2954571a-3b86-4884-83d0-23565d83f918 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:15.948253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2954571a-3b86-4884-83d0-23565d83f918 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:15.955365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2954571a-3b86-4884-83d0-23565d83f918 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:15.955816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2954571a-3b86-4884-83d0-23565d83f918 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:15.956577 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2954571a-3b86-4884-83d0-23565d83f918 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:15.957014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2954571a-3b86-4884-83d0-23565d83f918 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:15.986946 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2954571a-3b86-4884-83d0-23565d83f918 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043629 May 24 13:30:15.987490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 846/1685] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:16.998542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-98c75f4a-7758-4436-acbd-129c44923faa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:16.999458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-98c75f4a-7758-4436-acbd-129c44923faa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:17.005999 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98c75f4a-7758-4436-acbd-129c44923faa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:17.006476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98c75f4a-7758-4436-acbd-129c44923faa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:17.007232 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98c75f4a-7758-4436-acbd-129c44923faa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:17.007665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98c75f4a-7758-4436-acbd-129c44923faa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:17.039803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-98c75f4a-7758-4436-acbd-129c44923faa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045248 May 24 13:30:17.040345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 840/1686] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:18.051480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-03fb1925-340c-41c8-8a18-feb725128bd0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:18.052401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-03fb1925-340c-41c8-8a18-feb725128bd0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:18.058944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03fb1925-340c-41c8-8a18-feb725128bd0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:18.059387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03fb1925-340c-41c8-8a18-feb725128bd0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:18.060138 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03fb1925-340c-41c8-8a18-feb725128bd0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:18.060568 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-03fb1925-340c-41c8-8a18-feb725128bd0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:18.089372 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-03fb1925-340c-41c8-8a18-feb725128bd0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041844 May 24 13:30:18.089912 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 847/1687] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:19.100914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e398f7f8-af90-46ea-9523-0c93ac16c6e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:19.102168 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e398f7f8-af90-46ea-9523-0c93ac16c6e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:19.108696 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e398f7f8-af90-46ea-9523-0c93ac16c6e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:19.109153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e398f7f8-af90-46ea-9523-0c93ac16c6e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:19.109921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e398f7f8-af90-46ea-9523-0c93ac16c6e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:19.110406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e398f7f8-af90-46ea-9523-0c93ac16c6e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:19.139774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e398f7f8-af90-46ea-9523-0c93ac16c6e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042843 May 24 13:30:19.140322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 841/1688] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:20.152166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9b630394-6079-4425-9571-9c180300d597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:20.153093 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9b630394-6079-4425-9571-9c180300d597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:20.160068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b630394-6079-4425-9571-9c180300d597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:20.160519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b630394-6079-4425-9571-9c180300d597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:20.161276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b630394-6079-4425-9571-9c180300d597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:20.161742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b630394-6079-4425-9571-9c180300d597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:20.190892 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9b630394-6079-4425-9571-9c180300d597 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042665 May 24 13:30:20.191434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 848/1689] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:21.201917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-59e5e8b8-2331-4d13-b17a-33e0b3a359a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:21.202885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-59e5e8b8-2331-4d13-b17a-33e0b3a359a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:21.209349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59e5e8b8-2331-4d13-b17a-33e0b3a359a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:21.209796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59e5e8b8-2331-4d13-b17a-33e0b3a359a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:21.210584 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59e5e8b8-2331-4d13-b17a-33e0b3a359a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:21.211018 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59e5e8b8-2331-4d13-b17a-33e0b3a359a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:21.240421 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-59e5e8b8-2331-4d13-b17a-33e0b3a359a5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042549 May 24 13:30:21.240961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 842/1690] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:22.252598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-edd2a712-bf7c-427a-a61d-dd674251f1a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:22.253553 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-edd2a712-bf7c-427a-a61d-dd674251f1a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:22.260034 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edd2a712-bf7c-427a-a61d-dd674251f1a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:22.260485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edd2a712-bf7c-427a-a61d-dd674251f1a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:22.261244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edd2a712-bf7c-427a-a61d-dd674251f1a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:22.261685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edd2a712-bf7c-427a-a61d-dd674251f1a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:22.290643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-edd2a712-bf7c-427a-a61d-dd674251f1a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042574 May 24 13:30:22.291184 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 849/1691] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:23.302381 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d3de6b4c-31eb-4bfd-ae15-87a2b7b588b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:23.303231 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3de6b4c-31eb-4bfd-ae15-87a2b7b588b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:23.309711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3de6b4c-31eb-4bfd-ae15-87a2b7b588b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:23.310161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3de6b4c-31eb-4bfd-ae15-87a2b7b588b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:23.310952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3de6b4c-31eb-4bfd-ae15-87a2b7b588b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:23.311389 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3de6b4c-31eb-4bfd-ae15-87a2b7b588b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:23.340493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d3de6b4c-31eb-4bfd-ae15-87a2b7b588b9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042183 May 24 13:30:23.341040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 843/1692] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:24.352268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-880c8a72-509f-46b1-95d1-27ec4a13f50c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:24.353202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-880c8a72-509f-46b1-95d1-27ec4a13f50c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:24.360109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-880c8a72-509f-46b1-95d1-27ec4a13f50c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:24.360556 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-880c8a72-509f-46b1-95d1-27ec4a13f50c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:24.361306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-880c8a72-509f-46b1-95d1-27ec4a13f50c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:24.361739 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-880c8a72-509f-46b1-95d1-27ec4a13f50c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:24.391731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-880c8a72-509f-46b1-95d1-27ec4a13f50c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043658 May 24 13:30:24.392291 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 850/1693] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:25.404280 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ab204e0f-03c2-4dac-915e-f4cc56185ad5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:25.405294 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ab204e0f-03c2-4dac-915e-f4cc56185ad5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:25.411800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab204e0f-03c2-4dac-915e-f4cc56185ad5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:25.412251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab204e0f-03c2-4dac-915e-f4cc56185ad5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:25.413008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab204e0f-03c2-4dac-915e-f4cc56185ad5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:25.413442 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab204e0f-03c2-4dac-915e-f4cc56185ad5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:25.442241 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ab204e0f-03c2-4dac-915e-f4cc56185ad5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042022 May 24 13:30:25.442815 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 844/1694] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:26.453187 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-313a6ed3-0ed9-4657-85f7-c81479498cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:26.454113 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-313a6ed3-0ed9-4657-85f7-c81479498cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:26.460615 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-313a6ed3-0ed9-4657-85f7-c81479498cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:26.461345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-313a6ed3-0ed9-4657-85f7-c81479498cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:26.462097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-313a6ed3-0ed9-4657-85f7-c81479498cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:26.462559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-313a6ed3-0ed9-4657-85f7-c81479498cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:26.491458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-313a6ed3-0ed9-4657-85f7-c81479498cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042334 May 24 13:30:26.491998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 851/1695] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:27.503145 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4db8d57f-4e15-4748-85b5-ddd64adba946 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:27.503983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4db8d57f-4e15-4748-85b5-ddd64adba946 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:27.505981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:30:27.511460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4db8d57f-4e15-4748-85b5-ddd64adba946 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:27.511908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4db8d57f-4e15-4748-85b5-ddd64adba946 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:27.512670 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4db8d57f-4e15-4748-85b5-ddd64adba946 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:27.513118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4db8d57f-4e15-4748-85b5-ddd64adba946 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:27.516659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:30:27.543192 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4db8d57f-4e15-4748-85b5-ddd64adba946 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044314 May 24 13:30:27.543741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 845/1696] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:28.554963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6c460abd-abc4-4e50-a5b7-6efefd6edd82 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:28.555930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6c460abd-abc4-4e50-a5b7-6efefd6edd82 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:28.557895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:30:28.563785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c460abd-abc4-4e50-a5b7-6efefd6edd82 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:28.564238 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c460abd-abc4-4e50-a5b7-6efefd6edd82 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:28.565000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c460abd-abc4-4e50-a5b7-6efefd6edd82 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:28.565441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c460abd-abc4-4e50-a5b7-6efefd6edd82 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:28.569187 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:30:28.594720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6c460abd-abc4-4e50-a5b7-6efefd6edd82 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043821 May 24 13:30:28.595282 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 852/1697] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:29.606602 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2041a190-4c1c-4b11-9e4f-2d0f25995b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:29.607566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2041a190-4c1c-4b11-9e4f-2d0f25995b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:29.614584 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2041a190-4c1c-4b11-9e4f-2d0f25995b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:29.615034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2041a190-4c1c-4b11-9e4f-2d0f25995b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:29.615813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2041a190-4c1c-4b11-9e4f-2d0f25995b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:29.616250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2041a190-4c1c-4b11-9e4f-2d0f25995b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:29.646441 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2041a190-4c1c-4b11-9e4f-2d0f25995b20 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043767 May 24 13:30:29.647002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 846/1698] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:30.658119 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-50854824-98a9-4db6-b5c4-353d276fc35b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:30.659099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-50854824-98a9-4db6-b5c4-353d276fc35b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:30.665702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-50854824-98a9-4db6-b5c4-353d276fc35b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:30.666151 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-50854824-98a9-4db6-b5c4-353d276fc35b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:30.666955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-50854824-98a9-4db6-b5c4-353d276fc35b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:30.667394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-50854824-98a9-4db6-b5c4-353d276fc35b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:30.697146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-50854824-98a9-4db6-b5c4-353d276fc35b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042952 May 24 13:30:30.697619 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 853/1699] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:31.708659 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d675a3b0-7704-463a-9443-9f89ebc69435 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:31.709503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d675a3b0-7704-463a-9443-9f89ebc69435 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:31.715966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d675a3b0-7704-463a-9443-9f89ebc69435 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:31.716423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d675a3b0-7704-463a-9443-9f89ebc69435 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:31.717180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d675a3b0-7704-463a-9443-9f89ebc69435 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:31.717609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d675a3b0-7704-463a-9443-9f89ebc69435 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:31.746669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d675a3b0-7704-463a-9443-9f89ebc69435 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041994 May 24 13:30:31.747205 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 847/1700] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:32.758758 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-450f57f0-4bf1-406c-926e-b2c97b28ea1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:32.759694 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-450f57f0-4bf1-406c-926e-b2c97b28ea1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:32.765960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-450f57f0-4bf1-406c-926e-b2c97b28ea1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:32.766447 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-450f57f0-4bf1-406c-926e-b2c97b28ea1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:32.767215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-450f57f0-4bf1-406c-926e-b2c97b28ea1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:32.767655 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-450f57f0-4bf1-406c-926e-b2c97b28ea1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:32.797994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-450f57f0-4bf1-406c-926e-b2c97b28ea1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042570 May 24 13:30:32.798766 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 854/1701] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:33.809131 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-642549db-d680-4f1d-b70f-ed9a5c1e0c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:33.810083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-642549db-d680-4f1d-b70f-ed9a5c1e0c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:33.817191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-642549db-d680-4f1d-b70f-ed9a5c1e0c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:33.817643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-642549db-d680-4f1d-b70f-ed9a5c1e0c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:33.818435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-642549db-d680-4f1d-b70f-ed9a5c1e0c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:33.818872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-642549db-d680-4f1d-b70f-ed9a5c1e0c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:33.847399 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-642549db-d680-4f1d-b70f-ed9a5c1e0c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042255 May 24 13:30:33.847935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 848/1702] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:34.858446 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c002fa12-7b86-4685-b568-cf98bb3ca1cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:34.859369 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c002fa12-7b86-4685-b568-cf98bb3ca1cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:34.867013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c002fa12-7b86-4685-b568-cf98bb3ca1cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:34.867465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c002fa12-7b86-4685-b568-cf98bb3ca1cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:34.868228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c002fa12-7b86-4685-b568-cf98bb3ca1cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:34.868662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c002fa12-7b86-4685-b568-cf98bb3ca1cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:34.898766 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c002fa12-7b86-4685-b568-cf98bb3ca1cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044243 May 24 13:30:34.899351 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 855/1703] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:35.910096 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-557c4194-1a0c-4d2d-8a69-3143d5e45a78 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:35.911052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-557c4194-1a0c-4d2d-8a69-3143d5e45a78 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:35.917625 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-557c4194-1a0c-4d2d-8a69-3143d5e45a78 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:35.918082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-557c4194-1a0c-4d2d-8a69-3143d5e45a78 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:35.918942 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-557c4194-1a0c-4d2d-8a69-3143d5e45a78 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:35.919383 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-557c4194-1a0c-4d2d-8a69-3143d5e45a78 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:35.948906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-557c4194-1a0c-4d2d-8a69-3143d5e45a78 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043245 May 24 13:30:35.949509 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 849/1704] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:36.960570 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-06c2cc4c-8eae-4b32-9f2c-5ad5321d5609 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:36.961498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-06c2cc4c-8eae-4b32-9f2c-5ad5321d5609 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:36.967973 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-06c2cc4c-8eae-4b32-9f2c-5ad5321d5609 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:36.968427 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-06c2cc4c-8eae-4b32-9f2c-5ad5321d5609 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:36.969255 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-06c2cc4c-8eae-4b32-9f2c-5ad5321d5609 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:36.969690 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-06c2cc4c-8eae-4b32-9f2c-5ad5321d5609 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:36.999933 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-06c2cc4c-8eae-4b32-9f2c-5ad5321d5609 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043254 May 24 13:30:37.001275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 856/1705] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:38.011462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e54f8ae4-ed0d-4799-ba0a-189f90ad9b52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:38.012392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e54f8ae4-ed0d-4799-ba0a-189f90ad9b52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:38.019043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e54f8ae4-ed0d-4799-ba0a-189f90ad9b52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:38.019530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e54f8ae4-ed0d-4799-ba0a-189f90ad9b52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:38.020299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e54f8ae4-ed0d-4799-ba0a-189f90ad9b52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:38.020737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e54f8ae4-ed0d-4799-ba0a-189f90ad9b52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:38.050536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e54f8ae4-ed0d-4799-ba0a-189f90ad9b52 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043028 May 24 13:30:38.051089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 850/1706] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:39.061132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-030dd588-c7e8-4ff8-9e88-e5e4738f6d13 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:39.062050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-030dd588-c7e8-4ff8-9e88-e5e4738f6d13 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:39.069270 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-030dd588-c7e8-4ff8-9e88-e5e4738f6d13 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:39.069717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-030dd588-c7e8-4ff8-9e88-e5e4738f6d13 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:39.070498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-030dd588-c7e8-4ff8-9e88-e5e4738f6d13 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:39.070939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-030dd588-c7e8-4ff8-9e88-e5e4738f6d13 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:39.103452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-030dd588-c7e8-4ff8-9e88-e5e4738f6d13 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046242 May 24 13:30:39.104018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 857/1707] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:40.114894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-880cb9d0-df00-463c-b340-c389623cb7d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:40.115813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-880cb9d0-df00-463c-b340-c389623cb7d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:40.122248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-880cb9d0-df00-463c-b340-c389623cb7d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:40.122721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-880cb9d0-df00-463c-b340-c389623cb7d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:40.123500 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-880cb9d0-df00-463c-b340-c389623cb7d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:40.123932 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-880cb9d0-df00-463c-b340-c389623cb7d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:40.153512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-880cb9d0-df00-463c-b340-c389623cb7d5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042569 May 24 13:30:40.154050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 851/1708] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:41.165176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3bf0867d-c945-4d26-af71-d90e182a235e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:41.166167 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3bf0867d-c945-4d26-af71-d90e182a235e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:41.173521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3bf0867d-c945-4d26-af71-d90e182a235e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:41.173982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3bf0867d-c945-4d26-af71-d90e182a235e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:41.174787 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3bf0867d-c945-4d26-af71-d90e182a235e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:41.175230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3bf0867d-c945-4d26-af71-d90e182a235e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:41.204491 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3bf0867d-c945-4d26-af71-d90e182a235e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043318 May 24 13:30:41.205049 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 858/1709] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:42.215669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-17db8557-309d-4ec9-bcf8-d83670ee4485 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:42.216590 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-17db8557-309d-4ec9-bcf8-d83670ee4485 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:42.223081 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17db8557-309d-4ec9-bcf8-d83670ee4485 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:42.223527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17db8557-309d-4ec9-bcf8-d83670ee4485 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:42.224286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17db8557-309d-4ec9-bcf8-d83670ee4485 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:42.224722 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17db8557-309d-4ec9-bcf8-d83670ee4485 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:42.254272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-17db8557-309d-4ec9-bcf8-d83670ee4485 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042557 May 24 13:30:42.254833 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 852/1710] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:43.266607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6c426010-b70c-41e6-88e7-2bf4f447d546 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:43.267534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6c426010-b70c-41e6-88e7-2bf4f447d546 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:43.273970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c426010-b70c-41e6-88e7-2bf4f447d546 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:43.274451 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c426010-b70c-41e6-88e7-2bf4f447d546 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:43.275205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c426010-b70c-41e6-88e7-2bf4f447d546 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:43.275636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6c426010-b70c-41e6-88e7-2bf4f447d546 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:43.305597 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6c426010-b70c-41e6-88e7-2bf4f447d546 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043065 May 24 13:30:43.306145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 859/1711] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:44.317530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-96f8ec0d-1256-41e0-895f-f94b740d348d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:44.318520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-96f8ec0d-1256-41e0-895f-f94b740d348d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:44.324961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96f8ec0d-1256-41e0-895f-f94b740d348d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:44.325411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96f8ec0d-1256-41e0-895f-f94b740d348d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:44.326173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96f8ec0d-1256-41e0-895f-f94b740d348d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:44.326639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96f8ec0d-1256-41e0-895f-f94b740d348d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:44.357853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-96f8ec0d-1256-41e0-895f-f94b740d348d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044199 May 24 13:30:44.358364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 853/1712] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:45.369062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-43fd0e06-c4d9-412d-a91d-793caa8a7fa5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:45.369989 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-43fd0e06-c4d9-412d-a91d-793caa8a7fa5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:45.376975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-43fd0e06-c4d9-412d-a91d-793caa8a7fa5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:45.377420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-43fd0e06-c4d9-412d-a91d-793caa8a7fa5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:45.378174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-43fd0e06-c4d9-412d-a91d-793caa8a7fa5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:45.378636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-43fd0e06-c4d9-412d-a91d-793caa8a7fa5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:45.408666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-43fd0e06-c4d9-412d-a91d-793caa8a7fa5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043490 May 24 13:30:45.409223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 860/1713] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:46.419730 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-23a9607b-798c-48f3-a60d-ea3d90164e61 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:46.420646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-23a9607b-798c-48f3-a60d-ea3d90164e61 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:46.427654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23a9607b-798c-48f3-a60d-ea3d90164e61 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:46.428102 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23a9607b-798c-48f3-a60d-ea3d90164e61 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:46.428854 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23a9607b-798c-48f3-a60d-ea3d90164e61 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:46.429291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23a9607b-798c-48f3-a60d-ea3d90164e61 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:46.459095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-23a9607b-798c-48f3-a60d-ea3d90164e61 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043232 May 24 13:30:46.459575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 854/1714] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:47.470998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-84fbddd9-d3ad-43f0-b7cb-264e2137a492 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:47.471926 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-84fbddd9-d3ad-43f0-b7cb-264e2137a492 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:47.478679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-84fbddd9-d3ad-43f0-b7cb-264e2137a492 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:47.479128 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-84fbddd9-d3ad-43f0-b7cb-264e2137a492 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:47.479882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-84fbddd9-d3ad-43f0-b7cb-264e2137a492 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:47.480320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-84fbddd9-d3ad-43f0-b7cb-264e2137a492 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:47.509928 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-84fbddd9-d3ad-43f0-b7cb-264e2137a492 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043345 May 24 13:30:47.510489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 861/1715] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:48.521219 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3265aa99-22c5-430d-87ce-779db69c1923 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:48.522138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3265aa99-22c5-430d-87ce-779db69c1923 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:48.528746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3265aa99-22c5-430d-87ce-779db69c1923 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:48.529186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3265aa99-22c5-430d-87ce-779db69c1923 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:48.529943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3265aa99-22c5-430d-87ce-779db69c1923 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:48.530397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3265aa99-22c5-430d-87ce-779db69c1923 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:48.564006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3265aa99-22c5-430d-87ce-779db69c1923 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046758 May 24 13:30:48.564569 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 855/1716] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:49.575390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b0fcd4be-fa50-4d05-b818-1030fac66e73 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:49.576363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b0fcd4be-fa50-4d05-b818-1030fac66e73 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:49.583267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0fcd4be-fa50-4d05-b818-1030fac66e73 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:49.583904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0fcd4be-fa50-4d05-b818-1030fac66e73 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:49.584751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0fcd4be-fa50-4d05-b818-1030fac66e73 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:49.585196 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0fcd4be-fa50-4d05-b818-1030fac66e73 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:49.617302 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b0fcd4be-fa50-4d05-b818-1030fac66e73 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045887 May 24 13:30:49.617946 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 862/1717] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:50.629736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5eb57bf6-e459-4535-a220-bc803fb5f625 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:50.630807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5eb57bf6-e459-4535-a220-bc803fb5f625 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:50.637505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb57bf6-e459-4535-a220-bc803fb5f625 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:50.637970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb57bf6-e459-4535-a220-bc803fb5f625 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:50.638745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb57bf6-e459-4535-a220-bc803fb5f625 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:50.639178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb57bf6-e459-4535-a220-bc803fb5f625 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:50.669468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5eb57bf6-e459-4535-a220-bc803fb5f625 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043601 May 24 13:30:50.669984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 856/1718] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:51.681296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-150ba1c0-c3e9-45d8-b3ee-d6b0426c4766 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:51.682164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-150ba1c0-c3e9-45d8-b3ee-d6b0426c4766 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:51.689070 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-150ba1c0-c3e9-45d8-b3ee-d6b0426c4766 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:51.689523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-150ba1c0-c3e9-45d8-b3ee-d6b0426c4766 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:51.690313 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-150ba1c0-c3e9-45d8-b3ee-d6b0426c4766 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:51.690828 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-150ba1c0-c3e9-45d8-b3ee-d6b0426c4766 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:51.722677 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-150ba1c0-c3e9-45d8-b3ee-d6b0426c4766 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045299 May 24 13:30:51.723249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 863/1719] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:52.734821 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5188882b-f570-4b07-8724-2369b6136e76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:52.735758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5188882b-f570-4b07-8724-2369b6136e76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:52.742827 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5188882b-f570-4b07-8724-2369b6136e76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:52.743280 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5188882b-f570-4b07-8724-2369b6136e76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:52.744101 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5188882b-f570-4b07-8724-2369b6136e76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:52.744539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5188882b-f570-4b07-8724-2369b6136e76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:52.775257 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5188882b-f570-4b07-8724-2369b6136e76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044531 May 24 13:30:52.775828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 857/1720] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:53.788038 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2589c273-0f7c-468a-bd89-a7c84404815d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:53.789067 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2589c273-0f7c-468a-bd89-a7c84404815d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:53.797404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2589c273-0f7c-468a-bd89-a7c84404815d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:53.798094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2589c273-0f7c-468a-bd89-a7c84404815d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:53.798885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2589c273-0f7c-468a-bd89-a7c84404815d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:53.799325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2589c273-0f7c-468a-bd89-a7c84404815d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:53.829230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2589c273-0f7c-468a-bd89-a7c84404815d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045627 May 24 13:30:53.829804 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 864/1721] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:54.840568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-15883745-3f98-4330-825f-d21f840198dc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:54.841431 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-15883745-3f98-4330-825f-d21f840198dc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:54.848281 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15883745-3f98-4330-825f-d21f840198dc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:54.848726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15883745-3f98-4330-825f-d21f840198dc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:54.849498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15883745-3f98-4330-825f-d21f840198dc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:54.849936 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15883745-3f98-4330-825f-d21f840198dc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:54.885382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-15883745-3f98-4330-825f-d21f840198dc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048800 May 24 13:30:54.885899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 858/1722] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:55.897064 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-596bda10-f900-4925-94c3-d1ee6b8952b8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:55.897990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-596bda10-f900-4925-94c3-d1ee6b8952b8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:55.904486 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-596bda10-f900-4925-94c3-d1ee6b8952b8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:55.904919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-596bda10-f900-4925-94c3-d1ee6b8952b8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:55.905686 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-596bda10-f900-4925-94c3-d1ee6b8952b8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:55.906722 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-596bda10-f900-4925-94c3-d1ee6b8952b8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:55.935690 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-596bda10-f900-4925-94c3-d1ee6b8952b8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042460 May 24 13:30:55.936221 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 865/1723] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:56.947265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-09d0cf3e-86ab-4228-bb23-08639407cfd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:56.948203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-09d0cf3e-86ab-4228-bb23-08639407cfd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:56.954411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09d0cf3e-86ab-4228-bb23-08639407cfd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:56.954868 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09d0cf3e-86ab-4228-bb23-08639407cfd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:56.955638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09d0cf3e-86ab-4228-bb23-08639407cfd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:56.956093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09d0cf3e-86ab-4228-bb23-08639407cfd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:56.985557 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-09d0cf3e-86ab-4228-bb23-08639407cfd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042287 May 24 13:30:56.986107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 859/1724] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:57.996604 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-34c4add9-65ea-444f-9226-7d246d64e804 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:57.997580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-34c4add9-65ea-444f-9226-7d246d64e804 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:58.004243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34c4add9-65ea-444f-9226-7d246d64e804 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:58.004687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34c4add9-65ea-444f-9226-7d246d64e804 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:58.005439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34c4add9-65ea-444f-9226-7d246d64e804 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:58.005873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-34c4add9-65ea-444f-9226-7d246d64e804 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:58.034780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-34c4add9-65ea-444f-9226-7d246d64e804 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042109 May 24 13:30:58.035316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 866/1725] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:30:59.045640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dd4eb815-1e1b-4de1-a111-e4c60e5cd862 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:30:59.046598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dd4eb815-1e1b-4de1-a111-e4c60e5cd862 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:30:59.049035 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:30:59.054354 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd4eb815-1e1b-4de1-a111-e4c60e5cd862 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:59.054811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd4eb815-1e1b-4de1-a111-e4c60e5cd862 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:59.055607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd4eb815-1e1b-4de1-a111-e4c60e5cd862 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:30:59.056046 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd4eb815-1e1b-4de1-a111-e4c60e5cd862 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:30:59.059804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:30:59.085618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dd4eb815-1e1b-4de1-a111-e4c60e5cd862 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043921 May 24 13:30:59.086170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 860/1726] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:30:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:00.097566 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-68642710-a8ce-465b-8a60-05d1ae260ae0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:00.098522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-68642710-a8ce-465b-8a60-05d1ae260ae0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:00.101164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:31:00.106814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-68642710-a8ce-465b-8a60-05d1ae260ae0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:00.107268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-68642710-a8ce-465b-8a60-05d1ae260ae0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:00.108032 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-68642710-a8ce-465b-8a60-05d1ae260ae0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:00.108467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-68642710-a8ce-465b-8a60-05d1ae260ae0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:00.111419 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:31:00.138483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-68642710-a8ce-465b-8a60-05d1ae260ae0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045483 May 24 13:31:00.139028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 867/1727] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:01.149205 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-83f45c2c-d07d-41b3-873b-84a49f1fa4c1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:01.150121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-83f45c2c-d07d-41b3-873b-84a49f1fa4c1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:01.156728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83f45c2c-d07d-41b3-873b-84a49f1fa4c1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:01.157175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83f45c2c-d07d-41b3-873b-84a49f1fa4c1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:01.157928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83f45c2c-d07d-41b3-873b-84a49f1fa4c1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:01.158398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83f45c2c-d07d-41b3-873b-84a49f1fa4c1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:01.187726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-83f45c2c-d07d-41b3-873b-84a49f1fa4c1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041826 May 24 13:31:01.188265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 861/1728] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:02.199200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-545d1862-d5c8-4faf-9ff5-9ca5d8f00367 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:02.200194 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-545d1862-d5c8-4faf-9ff5-9ca5d8f00367 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:02.207171 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-545d1862-d5c8-4faf-9ff5-9ca5d8f00367 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:02.207622 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-545d1862-d5c8-4faf-9ff5-9ca5d8f00367 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:02.208386 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-545d1862-d5c8-4faf-9ff5-9ca5d8f00367 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:02.208820 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-545d1862-d5c8-4faf-9ff5-9ca5d8f00367 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:02.237993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-545d1862-d5c8-4faf-9ff5-9ca5d8f00367 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042728 May 24 13:31:02.238571 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 868/1729] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:03.248910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a1d24947-3c1c-4a76-b75a-2ab1c5699b9b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:03.250397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a1d24947-3c1c-4a76-b75a-2ab1c5699b9b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:03.256859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1d24947-3c1c-4a76-b75a-2ab1c5699b9b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:03.257314 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1d24947-3c1c-4a76-b75a-2ab1c5699b9b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:03.258082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1d24947-3c1c-4a76-b75a-2ab1c5699b9b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:03.258560 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1d24947-3c1c-4a76-b75a-2ab1c5699b9b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:03.287350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a1d24947-3c1c-4a76-b75a-2ab1c5699b9b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042411 May 24 13:31:03.287891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 862/1730] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:04.299617 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0240ac43-cd16-4d89-9933-5c35bfffb42b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:04.300568 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0240ac43-cd16-4d89-9933-5c35bfffb42b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:04.307101 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0240ac43-cd16-4d89-9933-5c35bfffb42b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:04.307555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0240ac43-cd16-4d89-9933-5c35bfffb42b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:04.308315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0240ac43-cd16-4d89-9933-5c35bfffb42b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:04.308755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0240ac43-cd16-4d89-9933-5c35bfffb42b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:04.338395 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0240ac43-cd16-4d89-9933-5c35bfffb42b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043149 May 24 13:31:04.338964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 869/1731] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:05.349834 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2d4fd24b-2a89-4cb8-99ea-c81adaa06a4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:05.351045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2d4fd24b-2a89-4cb8-99ea-c81adaa06a4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:05.357414 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d4fd24b-2a89-4cb8-99ea-c81adaa06a4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:05.357867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d4fd24b-2a89-4cb8-99ea-c81adaa06a4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:05.358679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d4fd24b-2a89-4cb8-99ea-c81adaa06a4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:05.359126 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d4fd24b-2a89-4cb8-99ea-c81adaa06a4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:05.391044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2d4fd24b-2a89-4cb8-99ea-c81adaa06a4a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044379 May 24 13:31:05.391607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 863/1732] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:06.402402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5a92cdc4-8283-484a-b0ef-7faf7d274a36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:06.403346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5a92cdc4-8283-484a-b0ef-7faf7d274a36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:06.409803 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a92cdc4-8283-484a-b0ef-7faf7d274a36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:06.410254 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a92cdc4-8283-484a-b0ef-7faf7d274a36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:06.411044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a92cdc4-8283-484a-b0ef-7faf7d274a36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:06.411654 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5a92cdc4-8283-484a-b0ef-7faf7d274a36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:06.442250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5a92cdc4-8283-484a-b0ef-7faf7d274a36 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043841 May 24 13:31:06.442831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 870/1733] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:07.457072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-95892850-f0cf-4b0e-8e20-ec0ac0c28917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:07.457991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-95892850-f0cf-4b0e-8e20-ec0ac0c28917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:07.464471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95892850-f0cf-4b0e-8e20-ec0ac0c28917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:07.464927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95892850-f0cf-4b0e-8e20-ec0ac0c28917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:07.465687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95892850-f0cf-4b0e-8e20-ec0ac0c28917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:07.466743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95892850-f0cf-4b0e-8e20-ec0ac0c28917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:07.496008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-95892850-f0cf-4b0e-8e20-ec0ac0c28917 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046177 May 24 13:31:07.496554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 864/1734] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:08.507580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-edc389dd-6545-406e-9b64-2ddf15217b3e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:08.508502 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-edc389dd-6545-406e-9b64-2ddf15217b3e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:08.514984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edc389dd-6545-406e-9b64-2ddf15217b3e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:08.515436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edc389dd-6545-406e-9b64-2ddf15217b3e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:08.516186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edc389dd-6545-406e-9b64-2ddf15217b3e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:08.516620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-edc389dd-6545-406e-9b64-2ddf15217b3e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:08.547052 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-edc389dd-6545-406e-9b64-2ddf15217b3e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042685 May 24 13:31:08.547620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 871/1735] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:09.558639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d61fb0f2-a950-46a0-a5fd-f3f0fff7a1df tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:09.559575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d61fb0f2-a950-46a0-a5fd-f3f0fff7a1df tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:09.566239 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d61fb0f2-a950-46a0-a5fd-f3f0fff7a1df tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:09.566702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d61fb0f2-a950-46a0-a5fd-f3f0fff7a1df tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:09.567461 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d61fb0f2-a950-46a0-a5fd-f3f0fff7a1df tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:09.567900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d61fb0f2-a950-46a0-a5fd-f3f0fff7a1df tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:09.597882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d61fb0f2-a950-46a0-a5fd-f3f0fff7a1df tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043228 May 24 13:31:09.598465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 865/1736] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:10.608967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6303e016-fe19-4337-98a4-feb306f6c7da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:10.609989 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6303e016-fe19-4337-98a4-feb306f6c7da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:10.616572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6303e016-fe19-4337-98a4-feb306f6c7da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:10.617025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6303e016-fe19-4337-98a4-feb306f6c7da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:10.617782 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6303e016-fe19-4337-98a4-feb306f6c7da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:10.618219 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6303e016-fe19-4337-98a4-feb306f6c7da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:10.648247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6303e016-fe19-4337-98a4-feb306f6c7da tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043221 May 24 13:31:10.648795 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 872/1737] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:11.659855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d2e693d1-8bf9-472e-b125-d299ac12951a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:11.660777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d2e693d1-8bf9-472e-b125-d299ac12951a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:11.667281 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2e693d1-8bf9-472e-b125-d299ac12951a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:11.667734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2e693d1-8bf9-472e-b125-d299ac12951a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:11.668499 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2e693d1-8bf9-472e-b125-d299ac12951a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:11.668944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2e693d1-8bf9-472e-b125-d299ac12951a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:11.697495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d2e693d1-8bf9-472e-b125-d299ac12951a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042211 May 24 13:31:11.698025 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 866/1738] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:12.709227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f3ac4ed8-bbf1-44f1-ac33-af8df432c5e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:12.710160 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f3ac4ed8-bbf1-44f1-ac33-af8df432c5e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:12.716652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ed8-bbf1-44f1-ac33-af8df432c5e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:12.717111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ed8-bbf1-44f1-ac33-af8df432c5e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:12.718745 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ed8-bbf1-44f1-ac33-af8df432c5e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:12.719200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ed8-bbf1-44f1-ac33-af8df432c5e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:12.748025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f3ac4ed8-bbf1-44f1-ac33-af8df432c5e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042709 May 24 13:31:12.748578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 873/1739] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:13.760081 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bbc741d5-82b9-4496-b0b4-4d05b35e64e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:13.761028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bbc741d5-82b9-4496-b0b4-4d05b35e64e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:13.767483 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbc741d5-82b9-4496-b0b4-4d05b35e64e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:13.767930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbc741d5-82b9-4496-b0b4-4d05b35e64e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:13.768688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbc741d5-82b9-4496-b0b4-4d05b35e64e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:13.769122 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbc741d5-82b9-4496-b0b4-4d05b35e64e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:13.798473 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bbc741d5-82b9-4496-b0b4-4d05b35e64e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042286 May 24 13:31:13.799013 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 867/1740] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:14.809274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4f7307c1-16f5-4bd4-83ae-00dcf2231770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:14.810225 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4f7307c1-16f5-4bd4-83ae-00dcf2231770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:14.817721 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f7307c1-16f5-4bd4-83ae-00dcf2231770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:14.818170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f7307c1-16f5-4bd4-83ae-00dcf2231770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:14.818958 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f7307c1-16f5-4bd4-83ae-00dcf2231770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:14.819392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4f7307c1-16f5-4bd4-83ae-00dcf2231770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:14.849138 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4f7307c1-16f5-4bd4-83ae-00dcf2231770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043878 May 24 13:31:14.849684 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 874/1741] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:15.865263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-937204f2-bff3-47cf-a1be-67735dfe092f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:15.866200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-937204f2-bff3-47cf-a1be-67735dfe092f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:15.872951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937204f2-bff3-47cf-a1be-67735dfe092f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:15.873448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937204f2-bff3-47cf-a1be-67735dfe092f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:15.874176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937204f2-bff3-47cf-a1be-67735dfe092f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:15.874640 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937204f2-bff3-47cf-a1be-67735dfe092f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:15.903594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-937204f2-bff3-47cf-a1be-67735dfe092f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046333 May 24 13:31:15.904194 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 868/1742] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:16.915756 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b23ccab1-5913-4d1a-b294-c19df9e3b64d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:16.916698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b23ccab1-5913-4d1a-b294-c19df9e3b64d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:16.923404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b23ccab1-5913-4d1a-b294-c19df9e3b64d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:16.923874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b23ccab1-5913-4d1a-b294-c19df9e3b64d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:16.924675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b23ccab1-5913-4d1a-b294-c19df9e3b64d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:16.925118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b23ccab1-5913-4d1a-b294-c19df9e3b64d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:16.954137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b23ccab1-5913-4d1a-b294-c19df9e3b64d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042393 May 24 13:31:16.954738 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 875/1743] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:17.965602 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-90c61cab-a228-4a96-9ef2-03cc93a71e07 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:17.966564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-90c61cab-a228-4a96-9ef2-03cc93a71e07 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:17.973011 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90c61cab-a228-4a96-9ef2-03cc93a71e07 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:17.973477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90c61cab-a228-4a96-9ef2-03cc93a71e07 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:17.974237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90c61cab-a228-4a96-9ef2-03cc93a71e07 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:17.974701 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90c61cab-a228-4a96-9ef2-03cc93a71e07 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:18.004479 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-90c61cab-a228-4a96-9ef2-03cc93a71e07 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042928 May 24 13:31:18.005026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 869/1744] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:19.016277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-926151da-3829-4781-a103-c3a58b1195c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:19.017137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-926151da-3829-4781-a103-c3a58b1195c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:19.023666 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-926151da-3829-4781-a103-c3a58b1195c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:19.024132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-926151da-3829-4781-a103-c3a58b1195c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:19.024906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-926151da-3829-4781-a103-c3a58b1195c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:19.025350 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-926151da-3829-4781-a103-c3a58b1195c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:19.055872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-926151da-3829-4781-a103-c3a58b1195c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043591 May 24 13:31:19.056426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 876/1745] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:20.067549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60a254ea-3127-4940-921d-fdc00038e6e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:20.068463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60a254ea-3127-4940-921d-fdc00038e6e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:20.075162 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60a254ea-3127-4940-921d-fdc00038e6e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:20.075604 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60a254ea-3127-4940-921d-fdc00038e6e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:20.076716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60a254ea-3127-4940-921d-fdc00038e6e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:20.077582 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60a254ea-3127-4940-921d-fdc00038e6e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:20.107507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60a254ea-3127-4940-921d-fdc00038e6e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043900 May 24 13:31:20.108056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 870/1746] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:21.118266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4619c5be-c3b0-4c21-87ac-4ce421a3b244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:21.119227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4619c5be-c3b0-4c21-87ac-4ce421a3b244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:21.126196 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4619c5be-c3b0-4c21-87ac-4ce421a3b244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:21.126695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4619c5be-c3b0-4c21-87ac-4ce421a3b244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:21.127464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4619c5be-c3b0-4c21-87ac-4ce421a3b244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:21.127907 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4619c5be-c3b0-4c21-87ac-4ce421a3b244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:21.157770 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4619c5be-c3b0-4c21-87ac-4ce421a3b244 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043082 May 24 13:31:21.158302 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 877/1747] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:22.167949 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b7ac54eb-805b-48b9-b35b-9ba0905f4b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:22.168880 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b7ac54eb-805b-48b9-b35b-9ba0905f4b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:22.175413 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7ac54eb-805b-48b9-b35b-9ba0905f4b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:22.175867 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7ac54eb-805b-48b9-b35b-9ba0905f4b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:22.176632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7ac54eb-805b-48b9-b35b-9ba0905f4b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:22.177074 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7ac54eb-805b-48b9-b35b-9ba0905f4b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:22.207104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b7ac54eb-805b-48b9-b35b-9ba0905f4b62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043085 May 24 13:31:22.207654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 871/1748] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:23.219357 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b75962a6-1172-4ddd-90b4-8cc8cd3c1252 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:23.220295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b75962a6-1172-4ddd-90b4-8cc8cd3c1252 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:23.227213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b75962a6-1172-4ddd-90b4-8cc8cd3c1252 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:23.227661 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b75962a6-1172-4ddd-90b4-8cc8cd3c1252 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:23.228422 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b75962a6-1172-4ddd-90b4-8cc8cd3c1252 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:23.228854 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b75962a6-1172-4ddd-90b4-8cc8cd3c1252 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:23.258227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b75962a6-1172-4ddd-90b4-8cc8cd3c1252 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043541 May 24 13:31:23.258796 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 878/1749] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:24.268855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-08a53cfb-11d6-497a-8981-b762daf1ca2d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:24.269783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-08a53cfb-11d6-497a-8981-b762daf1ca2d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:24.276230 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08a53cfb-11d6-497a-8981-b762daf1ca2d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:24.276685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08a53cfb-11d6-497a-8981-b762daf1ca2d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:24.277447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08a53cfb-11d6-497a-8981-b762daf1ca2d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:24.277884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08a53cfb-11d6-497a-8981-b762daf1ca2d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:24.307748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-08a53cfb-11d6-497a-8981-b762daf1ca2d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042766 May 24 13:31:24.308288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 872/1750] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:25.318986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1171f0b8-2077-4c69-a3a1-c81bd4a8ef40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:25.319923 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1171f0b8-2077-4c69-a3a1-c81bd4a8ef40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:25.326359 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1171f0b8-2077-4c69-a3a1-c81bd4a8ef40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:25.326850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1171f0b8-2077-4c69-a3a1-c81bd4a8ef40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:25.327618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1171f0b8-2077-4c69-a3a1-c81bd4a8ef40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:25.328061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1171f0b8-2077-4c69-a3a1-c81bd4a8ef40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:25.357490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1171f0b8-2077-4c69-a3a1-c81bd4a8ef40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042377 May 24 13:31:25.358689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 879/1751] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:26.369639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3ebbdf67-e035-4c02-a62d-b3d43715c157 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:26.370766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3ebbdf67-e035-4c02-a62d-b3d43715c157 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:26.377767 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ebbdf67-e035-4c02-a62d-b3d43715c157 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:26.378222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ebbdf67-e035-4c02-a62d-b3d43715c157 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:26.379028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ebbdf67-e035-4c02-a62d-b3d43715c157 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:26.379467 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ebbdf67-e035-4c02-a62d-b3d43715c157 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:26.409721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3ebbdf67-e035-4c02-a62d-b3d43715c157 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044014 May 24 13:31:26.410293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 873/1752] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:27.429648 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6bbb4f1b-afe1-4640-b09d-6d9d28c16228 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:27.431298 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6bbb4f1b-afe1-4640-b09d-6d9d28c16228 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:27.438105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6bbb4f1b-afe1-4640-b09d-6d9d28c16228 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:27.438618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6bbb4f1b-afe1-4640-b09d-6d9d28c16228 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:27.439397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6bbb4f1b-afe1-4640-b09d-6d9d28c16228 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:27.439838 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6bbb4f1b-afe1-4640-b09d-6d9d28c16228 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:27.468924 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6bbb4f1b-afe1-4640-b09d-6d9d28c16228 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051619 May 24 13:31:27.469480 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 880/1753] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:28.480754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8912812c-7e00-42ef-b699-f0d66ee9a29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:28.482252 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8912812c-7e00-42ef-b699-f0d66ee9a29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:28.489034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8912812c-7e00-42ef-b699-f0d66ee9a29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:28.489868 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8912812c-7e00-42ef-b699-f0d66ee9a29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:28.490888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8912812c-7e00-42ef-b699-f0d66ee9a29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:28.491385 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8912812c-7e00-42ef-b699-f0d66ee9a29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:28.523016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8912812c-7e00-42ef-b699-f0d66ee9a29e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046124 May 24 13:31:28.523573 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 874/1754] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:29.534456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e0e5fac7-6ad4-4000-838c-18cffb5f9b02 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:29.537683 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e0e5fac7-6ad4-4000-838c-18cffb5f9b02 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:29.541663 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e0e5fac7-6ad4-4000-838c-18cffb5f9b02 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:29.542118 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e0e5fac7-6ad4-4000-838c-18cffb5f9b02 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:29.542908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e0e5fac7-6ad4-4000-838c-18cffb5f9b02 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:29.543341 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e0e5fac7-6ad4-4000-838c-18cffb5f9b02 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:29.572762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e0e5fac7-6ad4-4000-838c-18cffb5f9b02 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042214 May 24 13:31:29.573309 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 881/1755] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:30.649542 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4ffe5ca8-f5ff-4729-9b6b-05bcd338db97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:30.650491 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4ffe5ca8-f5ff-4729-9b6b-05bcd338db97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:30.652303 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:31:30.657535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ca8-f5ff-4729-9b6b-05bcd338db97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:30.657995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ca8-f5ff-4729-9b6b-05bcd338db97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:30.658803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ca8-f5ff-4729-9b6b-05bcd338db97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:30.659240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ffe5ca8-f5ff-4729-9b6b-05bcd338db97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:30.663002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:31:30.689335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4ffe5ca8-f5ff-4729-9b6b-05bcd338db97 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.108256 May 24 13:31:30.689884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 875/1756] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:31.700426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8c5beb80-b7f0-4ca5-8134-8d9914a774b7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:31.701354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8c5beb80-b7f0-4ca5-8134-8d9914a774b7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:31.703841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:31:31.709286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8c5beb80-b7f0-4ca5-8134-8d9914a774b7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:31.709738 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8c5beb80-b7f0-4ca5-8134-8d9914a774b7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:31.710522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8c5beb80-b7f0-4ca5-8134-8d9914a774b7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:31.710959 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8c5beb80-b7f0-4ca5-8134-8d9914a774b7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:31.713295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:31:31.741430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8c5beb80-b7f0-4ca5-8134-8d9914a774b7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044941 May 24 13:31:31.741975 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 882/1757] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:32.753507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5fcfd423-303b-4441-84e0-0ba34d0784f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:32.754507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5fcfd423-303b-4441-84e0-0ba34d0784f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:32.761029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fcfd423-303b-4441-84e0-0ba34d0784f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:32.761467 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fcfd423-303b-4441-84e0-0ba34d0784f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:32.762229 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fcfd423-303b-4441-84e0-0ba34d0784f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:32.762689 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fcfd423-303b-4441-84e0-0ba34d0784f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:32.791166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5fcfd423-303b-4441-84e0-0ba34d0784f6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041571 May 24 13:31:32.791711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 876/1758] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:31:33.802237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-37aa288d-9ae2-4f26-b0fc-332f8591d9ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:33.803293 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-37aa288d-9ae2-4f26-b0fc-332f8591d9ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:33.810113 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-37aa288d-9ae2-4f26-b0fc-332f8591d9ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:33.810595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-37aa288d-9ae2-4f26-b0fc-332f8591d9ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:33.811910 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-37aa288d-9ae2-4f26-b0fc-332f8591d9ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:33.812311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-37aa288d-9ae2-4f26-b0fc-332f8591d9ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:33.855915 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-37aa288d-9ae2-4f26-b0fc-332f8591d9ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057583 May 24 13:31:33.856483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 883/1759] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:31:34.867331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ae58fb34-b39c-42ca-8587-edaacc94482c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:34.868253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ae58fb34-b39c-42ca-8587-edaacc94482c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:34.874664 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae58fb34-b39c-42ca-8587-edaacc94482c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:34.875107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae58fb34-b39c-42ca-8587-edaacc94482c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:34.875859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae58fb34-b39c-42ca-8587-edaacc94482c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:34.876291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae58fb34-b39c-42ca-8587-edaacc94482c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:34.906258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ae58fb34-b39c-42ca-8587-edaacc94482c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042873 May 24 13:31:34.906836 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 877/1760] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:35.917662 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5f35053f-74bc-44cc-96de-43a410719f2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:35.918610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5f35053f-74bc-44cc-96de-43a410719f2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:35.925561 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5f35053f-74bc-44cc-96de-43a410719f2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:35.926010 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5f35053f-74bc-44cc-96de-43a410719f2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:35.926797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5f35053f-74bc-44cc-96de-43a410719f2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:35.927235 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5f35053f-74bc-44cc-96de-43a410719f2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:35.956311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5f35053f-74bc-44cc-96de-43a410719f2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042556 May 24 13:31:35.956850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 884/1761] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:36.968207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a118245f-4c58-4e23-92e7-78b87cb46da1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:36.969127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a118245f-4c58-4e23-92e7-78b87cb46da1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:36.975782 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a118245f-4c58-4e23-92e7-78b87cb46da1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:36.976227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a118245f-4c58-4e23-92e7-78b87cb46da1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:36.976980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a118245f-4c58-4e23-92e7-78b87cb46da1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:36.977405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a118245f-4c58-4e23-92e7-78b87cb46da1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:37.006112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a118245f-4c58-4e23-92e7-78b87cb46da1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042418 May 24 13:31:37.006745 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 878/1762] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:38.017937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-19f08b4b-a000-452e-bd18-671bc4288678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:38.018891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-19f08b4b-a000-452e-bd18-671bc4288678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:38.025270 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-19f08b4b-a000-452e-bd18-671bc4288678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:38.025730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-19f08b4b-a000-452e-bd18-671bc4288678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:38.026541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-19f08b4b-a000-452e-bd18-671bc4288678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:38.026974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-19f08b4b-a000-452e-bd18-671bc4288678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:38.057037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-19f08b4b-a000-452e-bd18-671bc4288678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043408 May 24 13:31:38.057594 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 885/1763] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:39.068671 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-65966332-9ee4-4edc-b5ef-e71d2c1353cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:39.069589 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-65966332-9ee4-4edc-b5ef-e71d2c1353cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:39.077003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65966332-9ee4-4edc-b5ef-e71d2c1353cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:39.077452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65966332-9ee4-4edc-b5ef-e71d2c1353cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:39.078212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65966332-9ee4-4edc-b5ef-e71d2c1353cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:39.078676 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65966332-9ee4-4edc-b5ef-e71d2c1353cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:39.107661 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-65966332-9ee4-4edc-b5ef-e71d2c1353cc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042916 May 24 13:31:39.108214 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 879/1764] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:40.119438 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-86eedf43-f088-4842-862f-78c54119ecb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:40.120391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-86eedf43-f088-4842-862f-78c54119ecb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:40.126917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86eedf43-f088-4842-862f-78c54119ecb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:40.127364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86eedf43-f088-4842-862f-78c54119ecb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:40.128111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86eedf43-f088-4842-862f-78c54119ecb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:40.128542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-86eedf43-f088-4842-862f-78c54119ecb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:40.159208 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-86eedf43-f088-4842-862f-78c54119ecb9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043739 May 24 13:31:40.159794 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 886/1765] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:41.170678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b044c21b-6364-406e-a877-9a093d626675 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:41.171627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b044c21b-6364-406e-a877-9a093d626675 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:41.178131 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b044c21b-6364-406e-a877-9a093d626675 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:41.178607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b044c21b-6364-406e-a877-9a093d626675 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:41.179363 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b044c21b-6364-406e-a877-9a093d626675 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:41.179792 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b044c21b-6364-406e-a877-9a093d626675 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:41.209398 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b044c21b-6364-406e-a877-9a093d626675 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043223 May 24 13:31:41.209886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 880/1766] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:42.222940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f584284e-c19f-47f5-b45e-89e48dd7b5d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:42.226691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f584284e-c19f-47f5-b45e-89e48dd7b5d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:42.234070 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f584284e-c19f-47f5-b45e-89e48dd7b5d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:42.234546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f584284e-c19f-47f5-b45e-89e48dd7b5d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:42.235319 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f584284e-c19f-47f5-b45e-89e48dd7b5d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:42.235762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f584284e-c19f-47f5-b45e-89e48dd7b5d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:42.264844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f584284e-c19f-47f5-b45e-89e48dd7b5d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047982 May 24 13:31:42.265412 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 887/1767] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:43.276395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-531b01ba-4cac-40d5-a63f-3a8eaf079ed6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:43.277318 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-531b01ba-4cac-40d5-a63f-3a8eaf079ed6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:43.284380 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-531b01ba-4cac-40d5-a63f-3a8eaf079ed6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:43.284835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-531b01ba-4cac-40d5-a63f-3a8eaf079ed6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:43.285600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-531b01ba-4cac-40d5-a63f-3a8eaf079ed6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:43.286040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-531b01ba-4cac-40d5-a63f-3a8eaf079ed6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:43.314627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-531b01ba-4cac-40d5-a63f-3a8eaf079ed6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042109 May 24 13:31:43.315180 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 881/1768] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:44.326736 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a0efa73a-0806-438e-902a-ea0b53430891 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:44.327686 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a0efa73a-0806-438e-902a-ea0b53430891 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:44.334058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0efa73a-0806-438e-902a-ea0b53430891 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:44.334540 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0efa73a-0806-438e-902a-ea0b53430891 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:44.335295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0efa73a-0806-438e-902a-ea0b53430891 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:44.335726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a0efa73a-0806-438e-902a-ea0b53430891 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:44.365384 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a0efa73a-0806-438e-902a-ea0b53430891 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043054 May 24 13:31:44.365838 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 888/1769] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:45.376680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-639e0826-b3d5-47bd-8efd-c25b6d09ce7b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:45.377615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-639e0826-b3d5-47bd-8efd-c25b6d09ce7b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:45.384379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-639e0826-b3d5-47bd-8efd-c25b6d09ce7b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:45.384838 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-639e0826-b3d5-47bd-8efd-c25b6d09ce7b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:45.385622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-639e0826-b3d5-47bd-8efd-c25b6d09ce7b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:45.386063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-639e0826-b3d5-47bd-8efd-c25b6d09ce7b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:45.421618 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-639e0826-b3d5-47bd-8efd-c25b6d09ce7b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048804 May 24 13:31:45.422174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 882/1770] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:46.432962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-59c72b8f-d18e-4b7b-b301-9321be0184d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:46.433892 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-59c72b8f-d18e-4b7b-b301-9321be0184d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:46.441028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59c72b8f-d18e-4b7b-b301-9321be0184d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:46.441482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59c72b8f-d18e-4b7b-b301-9321be0184d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:46.442248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59c72b8f-d18e-4b7b-b301-9321be0184d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:46.442717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59c72b8f-d18e-4b7b-b301-9321be0184d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:46.471312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-59c72b8f-d18e-4b7b-b301-9321be0184d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042289 May 24 13:31:46.471860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 889/1771] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:47.482984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5f90e21b-40dc-4930-8b13-6506521349c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:47.483948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5f90e21b-40dc-4930-8b13-6506521349c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:47.490510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f90e21b-40dc-4930-8b13-6506521349c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:47.490968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f90e21b-40dc-4930-8b13-6506521349c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:47.491744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f90e21b-40dc-4930-8b13-6506521349c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:47.492186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f90e21b-40dc-4930-8b13-6506521349c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:47.521778 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5f90e21b-40dc-4930-8b13-6506521349c4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042748 May 24 13:31:47.522350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 883/1772] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:48.534239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1659eb9c-3f43-45be-9628-f2c808b1f4e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:48.535180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1659eb9c-3f43-45be-9628-f2c808b1f4e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:48.541510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1659eb9c-3f43-45be-9628-f2c808b1f4e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:48.541953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1659eb9c-3f43-45be-9628-f2c808b1f4e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:48.542732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1659eb9c-3f43-45be-9628-f2c808b1f4e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:48.543166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1659eb9c-3f43-45be-9628-f2c808b1f4e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:48.571200 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1659eb9c-3f43-45be-9628-f2c808b1f4e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.040852 May 24 13:31:48.571746 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 890/1773] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:49.582619 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c9206944-c0da-4b64-b8e6-020182b1de09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:49.583541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c9206944-c0da-4b64-b8e6-020182b1de09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:49.589967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c9206944-c0da-4b64-b8e6-020182b1de09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:49.590457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c9206944-c0da-4b64-b8e6-020182b1de09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:49.591221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c9206944-c0da-4b64-b8e6-020182b1de09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:49.592165 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c9206944-c0da-4b64-b8e6-020182b1de09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:49.621513 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c9206944-c0da-4b64-b8e6-020182b1de09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042889 May 24 13:31:49.622062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 884/1774] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:50.632125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0b649d2f-7f2d-43c6-90f1-401f139ad6b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:50.633045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0b649d2f-7f2d-43c6-90f1-401f139ad6b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:50.640025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b649d2f-7f2d-43c6-90f1-401f139ad6b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:50.640475 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b649d2f-7f2d-43c6-90f1-401f139ad6b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:50.641223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b649d2f-7f2d-43c6-90f1-401f139ad6b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:50.641656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0b649d2f-7f2d-43c6-90f1-401f139ad6b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:50.670376 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0b649d2f-7f2d-43c6-90f1-401f139ad6b4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041526 May 24 13:31:50.670849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 891/1775] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:51.680839 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2344600e-1186-425c-b919-0e1fd43574f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:51.681790 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2344600e-1186-425c-b919-0e1fd43574f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:51.688924 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2344600e-1186-425c-b919-0e1fd43574f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:51.689374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2344600e-1186-425c-b919-0e1fd43574f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:51.690120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2344600e-1186-425c-b919-0e1fd43574f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:51.690583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2344600e-1186-425c-b919-0e1fd43574f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:51.718773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2344600e-1186-425c-b919-0e1fd43574f2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041792 May 24 13:31:51.719306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 885/1776] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:52.730374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f994c7de-aed7-41c4-830d-11183bae79bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:52.731325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f994c7de-aed7-41c4-830d-11183bae79bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:52.737878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f994c7de-aed7-41c4-830d-11183bae79bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:52.738365 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f994c7de-aed7-41c4-830d-11183bae79bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:52.739139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f994c7de-aed7-41c4-830d-11183bae79bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:52.739552 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f994c7de-aed7-41c4-830d-11183bae79bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:52.768709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f994c7de-aed7-41c4-830d-11183bae79bd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042352 May 24 13:31:52.769253 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 892/1777] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:31:53.780293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-51bb6d5d-a516-4e5c-b5fb-924fcfcdfbde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:53.781227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-51bb6d5d-a516-4e5c-b5fb-924fcfcdfbde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:53.787678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51bb6d5d-a516-4e5c-b5fb-924fcfcdfbde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:53.788131 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51bb6d5d-a516-4e5c-b5fb-924fcfcdfbde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:53.788900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51bb6d5d-a516-4e5c-b5fb-924fcfcdfbde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:53.789341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51bb6d5d-a516-4e5c-b5fb-924fcfcdfbde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:53.819499 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-51bb6d5d-a516-4e5c-b5fb-924fcfcdfbde tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043432 May 24 13:31:53.820047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 886/1778] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:54.831636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b2fe4339-0556-4678-a2f8-0ace8acdf67a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:54.832596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b2fe4339-0556-4678-a2f8-0ace8acdf67a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:54.838993 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b2fe4339-0556-4678-a2f8-0ace8acdf67a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:54.839439 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b2fe4339-0556-4678-a2f8-0ace8acdf67a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:54.840193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b2fe4339-0556-4678-a2f8-0ace8acdf67a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:54.840622 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b2fe4339-0556-4678-a2f8-0ace8acdf67a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:54.869336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b2fe4339-0556-4678-a2f8-0ace8acdf67a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041769 May 24 13:31:54.869884 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 893/1779] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:55.880973 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1ef88e95-f4e4-4d45-8064-e917058ca16e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:55.881913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1ef88e95-f4e4-4d45-8064-e917058ca16e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:55.888996 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ef88e95-f4e4-4d45-8064-e917058ca16e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:55.889448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ef88e95-f4e4-4d45-8064-e917058ca16e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:55.890215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ef88e95-f4e4-4d45-8064-e917058ca16e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:55.890686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ef88e95-f4e4-4d45-8064-e917058ca16e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:55.926862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1ef88e95-f4e4-4d45-8064-e917058ca16e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049581 May 24 13:31:55.927337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 887/1780] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:56.939191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0f4da3f2-a28a-4a24-ad8f-bd00e9ff3114 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:56.940188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0f4da3f2-a28a-4a24-ad8f-bd00e9ff3114 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:56.946364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0f4da3f2-a28a-4a24-ad8f-bd00e9ff3114 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:56.946881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0f4da3f2-a28a-4a24-ad8f-bd00e9ff3114 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:56.947636 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0f4da3f2-a28a-4a24-ad8f-bd00e9ff3114 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:56.948067 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0f4da3f2-a28a-4a24-ad8f-bd00e9ff3114 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:56.977811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0f4da3f2-a28a-4a24-ad8f-bd00e9ff3114 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042610 May 24 13:31:56.978377 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 894/1781] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:57.989140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cad8cf73-8991-483f-bfc7-825acbabc590 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:57.990067 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cad8cf73-8991-483f-bfc7-825acbabc590 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:57.996040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cad8cf73-8991-483f-bfc7-825acbabc590 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:57.996486 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cad8cf73-8991-483f-bfc7-825acbabc590 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:57.997247 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cad8cf73-8991-483f-bfc7-825acbabc590 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:57.997693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cad8cf73-8991-483f-bfc7-825acbabc590 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:58.025964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cad8cf73-8991-483f-bfc7-825acbabc590 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.040941 May 24 13:31:58.026530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 888/1782] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:31:59.037084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-38127733-a8cf-4e98-98ec-d69c65ffd770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:31:59.038036 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-38127733-a8cf-4e98-98ec-d69c65ffd770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:31:59.044119 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38127733-a8cf-4e98-98ec-d69c65ffd770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:59.044590 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38127733-a8cf-4e98-98ec-d69c65ffd770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:59.045352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38127733-a8cf-4e98-98ec-d69c65ffd770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:31:59.045787 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-38127733-a8cf-4e98-98ec-d69c65ffd770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:31:59.074161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-38127733-a8cf-4e98-98ec-d69c65ffd770 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041139 May 24 13:31:59.074740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 895/1783] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:31:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:00.021641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:32:00.021848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:32:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:32:00.085212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ad277cc9-3805-4de0-963b-984c7fbb530b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:00.086140 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ad277cc9-3805-4de0-963b-984c7fbb530b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:00.093274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad277cc9-3805-4de0-963b-984c7fbb530b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:00.093718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad277cc9-3805-4de0-963b-984c7fbb530b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:00.094517 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad277cc9-3805-4de0-963b-984c7fbb530b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:00.094946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad277cc9-3805-4de0-963b-984c7fbb530b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:00.126206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ad277cc9-3805-4de0-963b-984c7fbb530b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044932 May 24 13:32:00.126802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 889/1784] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:01.137851 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4212eb57-48a5-4a50-b3ad-65e8ee8f3d01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:01.139348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4212eb57-48a5-4a50-b3ad-65e8ee8f3d01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:01.146102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4212eb57-48a5-4a50-b3ad-65e8ee8f3d01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:01.146585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4212eb57-48a5-4a50-b3ad-65e8ee8f3d01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:01.147381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4212eb57-48a5-4a50-b3ad-65e8ee8f3d01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:01.147819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4212eb57-48a5-4a50-b3ad-65e8ee8f3d01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:01.177986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4212eb57-48a5-4a50-b3ad-65e8ee8f3d01 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044211 May 24 13:32:01.178572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 896/1785] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:02.188950 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cdf03df6-6e68-44b3-88a3-055125e853cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:02.189894 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cdf03df6-6e68-44b3-88a3-055125e853cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:02.192307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:02.198219 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdf03df6-6e68-44b3-88a3-055125e853cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:02.198702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdf03df6-6e68-44b3-88a3-055125e853cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:02.199471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdf03df6-6e68-44b3-88a3-055125e853cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:02.199933 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdf03df6-6e68-44b3-88a3-055125e853cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:02.204299 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:02.231072 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cdf03df6-6e68-44b3-88a3-055125e853cd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046028 May 24 13:32:02.231622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 890/1786] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:03.242604 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1f147e22-4d92-45f4-b4a2-327f38a21d40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:03.243547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1f147e22-4d92-45f4-b4a2-327f38a21d40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:03.245974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:03.251646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1f147e22-4d92-45f4-b4a2-327f38a21d40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:03.252093 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1f147e22-4d92-45f4-b4a2-327f38a21d40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:03.252870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1f147e22-4d92-45f4-b4a2-327f38a21d40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:03.253316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1f147e22-4d92-45f4-b4a2-327f38a21d40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:03.257132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:03.284704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1f147e22-4d92-45f4-b4a2-327f38a21d40 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045980 May 24 13:32:03.285197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 897/1787] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:03.723429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:32:03.723657 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:32:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:32:04.296251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7d3e43d9-045e-410d-92a6-2e7ac2a608e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:04.297187 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7d3e43d9-045e-410d-92a6-2e7ac2a608e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:04.303691 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d3e43d9-045e-410d-92a6-2e7ac2a608e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:04.304146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d3e43d9-045e-410d-92a6-2e7ac2a608e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:04.304913 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d3e43d9-045e-410d-92a6-2e7ac2a608e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:04.305352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d3e43d9-045e-410d-92a6-2e7ac2a608e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:04.334954 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7d3e43d9-045e-410d-92a6-2e7ac2a608e6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042680 May 24 13:32:04.335504 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 891/1788] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:05.347241 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-deea4cbd-d98e-458a-add6-0baf7f157087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:05.347643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-deea4cbd-d98e-458a-add6-0baf7f157087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:05.354406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-deea4cbd-d98e-458a-add6-0baf7f157087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:05.354854 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-deea4cbd-d98e-458a-add6-0baf7f157087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:05.355610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-deea4cbd-d98e-458a-add6-0baf7f157087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:05.356044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-deea4cbd-d98e-458a-add6-0baf7f157087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:05.386141 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-deea4cbd-d98e-458a-add6-0baf7f157087 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043534 May 24 13:32:05.386742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 898/1789] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:06.397108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9533ca82-e5b0-4eba-8e16-6343619d7b3a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:06.398080 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9533ca82-e5b0-4eba-8e16-6343619d7b3a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:06.404807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9533ca82-e5b0-4eba-8e16-6343619d7b3a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:06.405200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9533ca82-e5b0-4eba-8e16-6343619d7b3a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:06.405926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9533ca82-e5b0-4eba-8e16-6343619d7b3a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:06.406388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9533ca82-e5b0-4eba-8e16-6343619d7b3a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:06.437236 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9533ca82-e5b0-4eba-8e16-6343619d7b3a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044093 May 24 13:32:06.437800 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 892/1790] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:07.448762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1dfb1a55-8df8-4ea8-8b41-07ccfee0a54a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:07.449690 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1dfb1a55-8df8-4ea8-8b41-07ccfee0a54a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:07.456961 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1dfb1a55-8df8-4ea8-8b41-07ccfee0a54a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:07.457415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1dfb1a55-8df8-4ea8-8b41-07ccfee0a54a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:07.458178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1dfb1a55-8df8-4ea8-8b41-07ccfee0a54a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:07.458635 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1dfb1a55-8df8-4ea8-8b41-07ccfee0a54a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:07.488844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1dfb1a55-8df8-4ea8-8b41-07ccfee0a54a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043999 May 24 13:32:07.489399 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 899/1791] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:08.501047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8d76319a-47a9-46f7-8e3e-c15091740b8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:08.502688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8d76319a-47a9-46f7-8e3e-c15091740b8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:08.509216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d76319a-47a9-46f7-8e3e-c15091740b8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:08.510029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d76319a-47a9-46f7-8e3e-c15091740b8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:08.510489 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d76319a-47a9-46f7-8e3e-c15091740b8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:08.510935 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d76319a-47a9-46f7-8e3e-c15091740b8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:08.541546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8d76319a-47a9-46f7-8e3e-c15091740b8e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044820 May 24 13:32:08.542118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 893/1792] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:09.553363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cbe0648f-e845-4e74-b6c7-c6247dc9856e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:09.554276 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cbe0648f-e845-4e74-b6c7-c6247dc9856e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:09.560883 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cbe0648f-e845-4e74-b6c7-c6247dc9856e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:09.561324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cbe0648f-e845-4e74-b6c7-c6247dc9856e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:09.562072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cbe0648f-e845-4e74-b6c7-c6247dc9856e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:09.562532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cbe0648f-e845-4e74-b6c7-c6247dc9856e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:09.592472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cbe0648f-e845-4e74-b6c7-c6247dc9856e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043023 May 24 13:32:09.593026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 900/1793] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:10.604851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c6622f32-6f09-481e-991e-10581dd35957 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:10.605801 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c6622f32-6f09-481e-991e-10581dd35957 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:10.613108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c6622f32-6f09-481e-991e-10581dd35957 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:10.613559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c6622f32-6f09-481e-991e-10581dd35957 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:10.614356 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c6622f32-6f09-481e-991e-10581dd35957 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:10.614796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c6622f32-6f09-481e-991e-10581dd35957 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:10.645341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c6622f32-6f09-481e-991e-10581dd35957 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044439 May 24 13:32:10.645837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 894/1794] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:11.657077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4cac165a-86da-4747-87c0-85d686f26d25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:11.657922 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4cac165a-86da-4747-87c0-85d686f26d25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:11.664462 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4cac165a-86da-4747-87c0-85d686f26d25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:11.664915 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4cac165a-86da-4747-87c0-85d686f26d25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:11.665668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4cac165a-86da-4747-87c0-85d686f26d25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:11.666104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4cac165a-86da-4747-87c0-85d686f26d25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:11.696466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4cac165a-86da-4747-87c0-85d686f26d25 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043473 May 24 13:32:11.697024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 901/1795] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:12.708255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7210999a-3466-4bc9-a959-e3da9b81e1d0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:12.709123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7210999a-3466-4bc9-a959-e3da9b81e1d0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:12.716235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7210999a-3466-4bc9-a959-e3da9b81e1d0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:12.716679 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7210999a-3466-4bc9-a959-e3da9b81e1d0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:12.717426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7210999a-3466-4bc9-a959-e3da9b81e1d0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:12.717855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7210999a-3466-4bc9-a959-e3da9b81e1d0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:12.747485 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7210999a-3466-4bc9-a959-e3da9b81e1d0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042960 May 24 13:32:12.748030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 895/1796] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:13.759046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-217661b7-97bc-436c-800f-52003bac93f5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:13.759884 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-217661b7-97bc-436c-800f-52003bac93f5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:13.766397 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-217661b7-97bc-436c-800f-52003bac93f5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:13.766850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-217661b7-97bc-436c-800f-52003bac93f5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:13.767598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-217661b7-97bc-436c-800f-52003bac93f5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:13.768031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-217661b7-97bc-436c-800f-52003bac93f5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:13.798127 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-217661b7-97bc-436c-800f-52003bac93f5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043034 May 24 13:32:13.798706 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 902/1797] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:14.810368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fdb7a781-1aa4-4c21-9663-b944e38c8ba7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:14.811209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fdb7a781-1aa4-4c21-9663-b944e38c8ba7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:14.817576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdb7a781-1aa4-4c21-9663-b944e38c8ba7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:14.818025 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdb7a781-1aa4-4c21-9663-b944e38c8ba7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:14.818826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdb7a781-1aa4-4c21-9663-b944e38c8ba7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:14.819264 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdb7a781-1aa4-4c21-9663-b944e38c8ba7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:14.848262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fdb7a781-1aa4-4c21-9663-b944e38c8ba7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042490 May 24 13:32:14.848817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 896/1798] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:15.860646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5077a571-c0f3-4456-bdbf-699efe32cf63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:15.861559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5077a571-c0f3-4456-bdbf-699efe32cf63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:15.867986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5077a571-c0f3-4456-bdbf-699efe32cf63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:15.868436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5077a571-c0f3-4456-bdbf-699efe32cf63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:15.869186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5077a571-c0f3-4456-bdbf-699efe32cf63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:15.869618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5077a571-c0f3-4456-bdbf-699efe32cf63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:15.898682 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5077a571-c0f3-4456-bdbf-699efe32cf63 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042565 May 24 13:32:15.899248 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 903/1799] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:16.910207 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cf6db8bc-f5b9-45f6-8c31-3179bf5198e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:16.911196 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cf6db8bc-f5b9-45f6-8c31-3179bf5198e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:16.917667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf6db8bc-f5b9-45f6-8c31-3179bf5198e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:16.918121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf6db8bc-f5b9-45f6-8c31-3179bf5198e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:16.918914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf6db8bc-f5b9-45f6-8c31-3179bf5198e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:16.919352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf6db8bc-f5b9-45f6-8c31-3179bf5198e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:16.947716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cf6db8bc-f5b9-45f6-8c31-3179bf5198e1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041509 May 24 13:32:16.948272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 897/1800] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:32:17.959625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-90e0f903-80a7-417e-aa9b-d1ce1223ef4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:17.960547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-90e0f903-80a7-417e-aa9b-d1ce1223ef4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:17.966972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90e0f903-80a7-417e-aa9b-d1ce1223ef4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:17.967414 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90e0f903-80a7-417e-aa9b-d1ce1223ef4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:17.968165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90e0f903-80a7-417e-aa9b-d1ce1223ef4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:17.968599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90e0f903-80a7-417e-aa9b-d1ce1223ef4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:17.998971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-90e0f903-80a7-417e-aa9b-d1ce1223ef4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043296 May 24 13:32:18.000165 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 904/1801] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:19.010339 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1e4c8320-7ff1-4ce1-ab3f-d5414a2023f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:19.011274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1e4c8320-7ff1-4ce1-ab3f-d5414a2023f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:19.017748 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e4c8320-7ff1-4ce1-ab3f-d5414a2023f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:19.018206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e4c8320-7ff1-4ce1-ab3f-d5414a2023f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:19.019014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e4c8320-7ff1-4ce1-ab3f-d5414a2023f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:19.019455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e4c8320-7ff1-4ce1-ab3f-d5414a2023f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:19.048968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1e4c8320-7ff1-4ce1-ab3f-d5414a2023f7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042530 May 24 13:32:19.049460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 898/1802] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:20.060800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-80e6f0a4-e15c-4676-9239-dc00452604ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:20.061731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-80e6f0a4-e15c-4676-9239-dc00452604ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:20.068229 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-80e6f0a4-e15c-4676-9239-dc00452604ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:20.068685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-80e6f0a4-e15c-4676-9239-dc00452604ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:20.069555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-80e6f0a4-e15c-4676-9239-dc00452604ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:20.070001 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-80e6f0a4-e15c-4676-9239-dc00452604ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:20.099093 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-80e6f0a4-e15c-4676-9239-dc00452604ab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042813 May 24 13:32:20.099852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 905/1803] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:21.110359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-948fcffd-e7e7-4130-abdd-93b197a4f4bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:21.111287 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-948fcffd-e7e7-4130-abdd-93b197a4f4bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:21.117636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-948fcffd-e7e7-4130-abdd-93b197a4f4bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:21.118082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-948fcffd-e7e7-4130-abdd-93b197a4f4bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:21.118877 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-948fcffd-e7e7-4130-abdd-93b197a4f4bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:21.119307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-948fcffd-e7e7-4130-abdd-93b197a4f4bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:21.149148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-948fcffd-e7e7-4130-abdd-93b197a4f4bb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042692 May 24 13:32:21.149628 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 899/1804] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:22.160562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5d40720e-407c-4f54-b30f-7cab29dfe1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:22.161494 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5d40720e-407c-4f54-b30f-7cab29dfe1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:22.167904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d40720e-407c-4f54-b30f-7cab29dfe1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:22.168356 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d40720e-407c-4f54-b30f-7cab29dfe1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:22.169112 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d40720e-407c-4f54-b30f-7cab29dfe1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:22.169582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5d40720e-407c-4f54-b30f-7cab29dfe1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:22.197880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5d40720e-407c-4f54-b30f-7cab29dfe1ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041263 May 24 13:32:22.198374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 906/1805] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:23.209081 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e03e5281-6724-4a55-8e84-3e1a9185866b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:23.209922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e03e5281-6724-4a55-8e84-3e1a9185866b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:23.217238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e03e5281-6724-4a55-8e84-3e1a9185866b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:23.217684 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e03e5281-6724-4a55-8e84-3e1a9185866b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:23.218482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e03e5281-6724-4a55-8e84-3e1a9185866b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:23.218921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e03e5281-6724-4a55-8e84-3e1a9185866b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:23.248047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e03e5281-6724-4a55-8e84-3e1a9185866b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043029 May 24 13:32:23.248579 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 900/1806] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:24.259542 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-815c55ba-efe7-4150-83d5-4abec23548a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:24.260468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-815c55ba-efe7-4150-83d5-4abec23548a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:24.267117 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-815c55ba-efe7-4150-83d5-4abec23548a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:24.267581 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-815c55ba-efe7-4150-83d5-4abec23548a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:24.268382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-815c55ba-efe7-4150-83d5-4abec23548a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:24.268826 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-815c55ba-efe7-4150-83d5-4abec23548a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:24.298941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-815c55ba-efe7-4150-83d5-4abec23548a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043320 May 24 13:32:24.299430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 907/1807] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:25.310910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7af29483-7c2c-4407-a314-3d13bb9f301a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:25.311888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7af29483-7c2c-4407-a314-3d13bb9f301a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:25.318512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7af29483-7c2c-4407-a314-3d13bb9f301a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:25.318912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7af29483-7c2c-4407-a314-3d13bb9f301a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:25.319683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7af29483-7c2c-4407-a314-3d13bb9f301a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:25.320123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7af29483-7c2c-4407-a314-3d13bb9f301a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:25.349455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7af29483-7c2c-4407-a314-3d13bb9f301a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042857 May 24 13:32:25.350016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 901/1808] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:26.361139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-30e71b39-e43d-4159-93f8-6d415bdc8c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:26.362094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-30e71b39-e43d-4159-93f8-6d415bdc8c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:26.368606 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30e71b39-e43d-4159-93f8-6d415bdc8c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:26.369057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30e71b39-e43d-4159-93f8-6d415bdc8c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:26.369819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30e71b39-e43d-4159-93f8-6d415bdc8c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:26.370257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-30e71b39-e43d-4159-93f8-6d415bdc8c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:26.400351 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-30e71b39-e43d-4159-93f8-6d415bdc8c38 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043114 May 24 13:32:26.400910 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 908/1809] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:27.412093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c5e3b8ab-a04e-4be7-a9fa-d029b3f8d99c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:27.413056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c5e3b8ab-a04e-4be7-a9fa-d029b3f8d99c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:27.421503 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5e3b8ab-a04e-4be7-a9fa-d029b3f8d99c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:27.422416 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5e3b8ab-a04e-4be7-a9fa-d029b3f8d99c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:27.423334 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5e3b8ab-a04e-4be7-a9fa-d029b3f8d99c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:27.424722 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5e3b8ab-a04e-4be7-a9fa-d029b3f8d99c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:27.453982 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c5e3b8ab-a04e-4be7-a9fa-d029b3f8d99c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046019 May 24 13:32:27.454567 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 902/1810] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:27.814002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:32:27.814254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:32:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:32:28.466243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-aec9392e-706b-46eb-bbb3-a627f3485599 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:28.467128 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-aec9392e-706b-46eb-bbb3-a627f3485599 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:28.473287 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aec9392e-706b-46eb-bbb3-a627f3485599 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:28.473733 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aec9392e-706b-46eb-bbb3-a627f3485599 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:28.474773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aec9392e-706b-46eb-bbb3-a627f3485599 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:28.475204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-aec9392e-706b-46eb-bbb3-a627f3485599 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:28.505824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-aec9392e-706b-46eb-bbb3-a627f3485599 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044144 May 24 13:32:28.508856 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 909/1811] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:29.517727 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ac3ffb72-d544-4efd-b10c-f0a4f722a790 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:29.518641 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ac3ffb72-d544-4efd-b10c-f0a4f722a790 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:29.525089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac3ffb72-d544-4efd-b10c-f0a4f722a790 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:29.525533 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac3ffb72-d544-4efd-b10c-f0a4f722a790 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:29.526306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac3ffb72-d544-4efd-b10c-f0a4f722a790 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:29.526738 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ac3ffb72-d544-4efd-b10c-f0a4f722a790 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:29.555347 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ac3ffb72-d544-4efd-b10c-f0a4f722a790 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041610 May 24 13:32:29.555885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 903/1812] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:30.567363 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-dbbbb30e-0948-4d8d-ad29-d888443f1e66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:30.568316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-dbbbb30e-0948-4d8d-ad29-d888443f1e66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:30.574790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbbbb30e-0948-4d8d-ad29-d888443f1e66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:30.575233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbbbb30e-0948-4d8d-ad29-d888443f1e66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:30.575995 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbbbb30e-0948-4d8d-ad29-d888443f1e66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:30.576429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-dbbbb30e-0948-4d8d-ad29-d888443f1e66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:30.605114 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-dbbbb30e-0948-4d8d-ad29-d888443f1e66 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041653 May 24 13:32:30.606162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 910/1813] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:31.412181 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2ad5be82-c197-4411-bcb0-09d0998a3c29 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:31.412712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2ad5be82-c197-4411-bcb0-09d0998a3c29 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:31.419686 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ad5be82-c197-4411-bcb0-09d0998a3c29 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:31.420141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ad5be82-c197-4411-bcb0-09d0998a3c29 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:31.420904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ad5be82-c197-4411-bcb0-09d0998a3c29 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:31.421342 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ad5be82-c197-4411-bcb0-09d0998a3c29 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:31.446436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2ad5be82-c197-4411-bcb0-09d0998a3c29 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:32:31.521153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2ad5be82-c197-4411-bcb0-09d0998a3c29 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 204 len: 0 microversion: 2.1 time: 0.112533 May 24 13:32:31.521817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 904/1814] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:32:31 2022] DELETE /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:32:31.530410 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6fed0d5f-b5f9-49d2-b333-d11e8783e19b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:31.531061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6fed0d5f-b5f9-49d2-b333-d11e8783e19b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:31.537325 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6fed0d5f-b5f9-49d2-b333-d11e8783e19b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:31.537782 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6fed0d5f-b5f9-49d2-b333-d11e8783e19b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:31.538598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6fed0d5f-b5f9-49d2-b333-d11e8783e19b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:31.539044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6fed0d5f-b5f9-49d2-b333-d11e8783e19b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:31.618118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e18a7f6a-6a82-495a-a0c0-b5c826bfa8d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:31.619166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e18a7f6a-6a82-495a-a0c0-b5c826bfa8d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:31.626003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e18a7f6a-6a82-495a-a0c0-b5c826bfa8d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:31.626505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e18a7f6a-6a82-495a-a0c0-b5c826bfa8d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:31.627307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e18a7f6a-6a82-495a-a0c0-b5c826bfa8d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:31.627734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e18a7f6a-6a82-495a-a0c0-b5c826bfa8d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:31.631543 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:31.659430 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e18a7f6a-6a82-495a-a0c0-b5c826bfa8d4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046148 May 24 13:32:31.659983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 905/1815] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:32:31.711031 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6fed0d5f-b5f9-49d2-b333-d11e8783e19b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:31.718921 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6fed0d5f-b5f9-49d2-b333-d11e8783e19b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1681 microversion: 2.1 time: 0.192954 May 24 13:32:31.719484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 911/1816] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:31 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:32.672130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8c92f246-1878-4c2b-b052-ce50fe102d28 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:32.673016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8c92f246-1878-4c2b-b052-ce50fe102d28 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:32.675331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:32.680653 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c92f246-1878-4c2b-b052-ce50fe102d28 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:32.681112 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c92f246-1878-4c2b-b052-ce50fe102d28 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:32.681885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c92f246-1878-4c2b-b052-ce50fe102d28 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:32.682348 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c92f246-1878-4c2b-b052-ce50fe102d28 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:32.713948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8c92f246-1878-4c2b-b052-ce50fe102d28 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046370 May 24 13:32:32.714559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 906/1817] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:32.736851 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d6d61791-5e17-44b6-a40e-3cda3ba94ac0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:32.737468 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d6d61791-5e17-44b6-a40e-3cda3ba94ac0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:32.743670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d6d61791-5e17-44b6-a40e-3cda3ba94ac0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:32.744114 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d6d61791-5e17-44b6-a40e-3cda3ba94ac0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:32.744871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d6d61791-5e17-44b6-a40e-3cda3ba94ac0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:32.745308 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d6d61791-5e17-44b6-a40e-3cda3ba94ac0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:32.910314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d6d61791-5e17-44b6-a40e-3cda3ba94ac0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:32.919110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d6d61791-5e17-44b6-a40e-3cda3ba94ac0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 200 len: 1681 microversion: 2.1 time: 0.186084 May 24 13:32:32.920190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 912/1818] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:32 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:33.245647 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-beae0187-4beb-41e9-89f3-410d856e475d req-c72fb3b3-1d27-493b-8e8f-09591d5ac4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ec8d2b-f986-4adc-b95a-579cfe890df5", "name": "network-vif-deleted", "tag": "c935dbbc-e14b-439f-84c1-6277e77f9109"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:32:33.256364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-beae0187-4beb-41e9-89f3-410d856e475d req-c72fb3b3-1d27-493b-8e8f-09591d5ac4f1 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:33.256817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-beae0187-4beb-41e9-89f3-410d856e475d req-c72fb3b3-1d27-493b-8e8f-09591d5ac4f1 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:33.271370 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-beae0187-4beb-41e9-89f3-410d856e475d req-c72fb3b3-1d27-493b-8e8f-09591d5ac4f1 service nova] Creating event network-vif-deleted:c935dbbc-e14b-439f-84c1-6277e77f9109 for instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 on hv-cinder-84301 May 24 13:32:33.278063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-beae0187-4beb-41e9-89f3-410d856e475d req-c72fb3b3-1d27-493b-8e8f-09591d5ac4f1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107887 May 24 13:32:33.278816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 907/1819] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:33.726204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f99cdd11-ac22-43cf-9d9a-57d8067851e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:33.727478 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f99cdd11-ac22-43cf-9d9a-57d8067851e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:33.732873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=32 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:33.735593 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f99cdd11-ac22-43cf-9d9a-57d8067851e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:33.736367 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f99cdd11-ac22-43cf-9d9a-57d8067851e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:33.737625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f99cdd11-ac22-43cf-9d9a-57d8067851e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:33.738410 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f99cdd11-ac22-43cf-9d9a-57d8067851e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:33.743081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=96 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:33.781685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f99cdd11-ac22-43cf-9d9a-57d8067851e8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060148 May 24 13:32:33.782265 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 913/1820] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:33.938828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:33.939672 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:33.945744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:33.946195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:33.946984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:33.947419 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:33.960915 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] HTTP exception thrown: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Request method failure captured: May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 HTTP/1.1 May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNxWbgojkvVeYfqT7qAAM-63IKyOy4HuVQZHO3TkekbFkRqF4Z24zjaxBuqGxV8t8tOElHAT9A39AejgeB71yIFb-bN_wCaieFZ3ov3_opuWr_AuuR50Kdpbw8WF7BJ-d88iA06iZabGRwDSbBj-0N_G80A7xL4b8y33glGNhNaYVLc May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:32:33.962551 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: e13a5203bc06439ba86befd2eb849ba5 May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:32:33.964471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'b4ec8d2b-f986-4adc-b95a-579cfe890df5'} May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:32:33.965435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:32:33.967091 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:32:33.968539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Returning 404 to user: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:32:33.968539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-17bc2218-a516-4c76-a805-9aea2961b48f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 404 len: 111 microversion: 2.1 time: 0.031222 May 24 13:32:33.968539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 908/1821] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:33 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 13:32:33.972836 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6c7cd681-e184-4d2d-9e91-b4f1376ba91f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '.version_select at 0x7f9a65ca3820>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:33.995964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6c7cd681-e184-4d2d-9e91-b4f1376ba91f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424270203" status: 202 len: 0 microversion: 2.1 time: 0.026775 May 24 13:32:33.997286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 914/1822] 10.222.0.45 () {58 vars in 1217 bytes} [Tue May 24 13:32:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424270203 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:32:34.632873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bcd0ed81-d67d-45ad-ab04-60f4748795cc tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Action: 'create', calling method: .version_select at 0x7f9a67190a60>, body: {"keypair": {"name": "tempest-keypair-2064986842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/8DA0qt5W0DKSmWqqZNvWt0YFptLv2LHyijPOChwqdrFBa87Fgsu2fX5FQJesdPv1PASl3qYqWAsD6pkiNplI7OjkeSAwa11X5tFLzaxKVtmiiQpU5/JOofNtXNmpmaA=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:32:34.646701 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-bcd0ed81-d67d-45ad-ab04-60f4748795cc tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for project cb54f85be3994a40a4b52e576b36c6da. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:32:34.650532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-bcd0ed81-d67d-45ad-ab04-60f4748795cc tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for user e13a5203bc06439ba86befd2eb849ba5 and project cb54f85be3994a40a4b52e576b36c6da. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:32:34.675471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bcd0ed81-d67d-45ad-ab04-60f4748795cc tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046564 May 24 13:32:34.676065 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 909/1823] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 13:32:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:34.793848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9062a77e-229d-42d9-9c98-47b43925fa64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:34.794865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9062a77e-229d-42d9-9c98-47b43925fa64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:34.803297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9062a77e-229d-42d9-9c98-47b43925fa64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:34.803759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9062a77e-229d-42d9-9c98-47b43925fa64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:34.804544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9062a77e-229d-42d9-9c98-47b43925fa64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:34.804987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9062a77e-229d-42d9-9c98-47b43925fa64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:34.835133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9062a77e-229d-42d9-9c98-47b43925fa64 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045918 May 24 13:32:34.835709 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 915/1824] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:32:35.847494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a5048a7-ccda-4e55-aad6-9177d3614212 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:35.848414 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a5048a7-ccda-4e55-aad6-9177d3614212 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:35.858014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a5048a7-ccda-4e55-aad6-9177d3614212 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:35.858513 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a5048a7-ccda-4e55-aad6-9177d3614212 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:35.859283 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a5048a7-ccda-4e55-aad6-9177d3614212 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:35.859718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a5048a7-ccda-4e55-aad6-9177d3614212 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:35.889286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a5048a7-ccda-4e55-aad6-9177d3614212 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046345 May 24 13:32:35.889849 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 910/1825] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:32:36.153912 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1968719964", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb5c4934-469a-4d18-945a-966849c00eff"}], "security_groups": [{"name": "tempest-securitygroup--433501612"}], "key_name": "tempest-keypair-2064986842", "user_data": "}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:32:36.252283 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.network.neutron [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] validate_networks() for [('fb5c4934-469a-4d18-945a-966849c00eff', None, None, None, None, None)] {{(pid=117643) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:32:36.671537 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Flavor limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:32:36.671965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Image limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:32:36.672460 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Flavor pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:32:36.672868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Image pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:32:36.673279 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:32:36.682203 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:36.682679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:36.684027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:36.684470 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:36.700909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for project cb54f85be3994a40a4b52e576b36c6da. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:32:36.704751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for user e13a5203bc06439ba86befd2eb849ba5 and project cb54f85be3994a40a4b52e576b36c6da. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:32:36.715467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Going to run 1 instances... {{(pid=117643) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:32:36.717698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:32:36.766842 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5b177eb7-9b2e-4480-b191-0158abf941a2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.617652 May 24 13:32:36.767490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 916/1826] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:32:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:32:36.777974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b08c1d9d-db8b-4125-863b-81aedd262823 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:36.778698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b08c1d9d-db8b-4125-863b-81aedd262823 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:36.877394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b08c1d9d-db8b-4125-863b-81aedd262823 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:36.884275 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b08c1d9d-db8b-4125-863b-81aedd262823 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1242 microversion: 2.1 time: 0.110837 May 24 13:32:36.884835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 911/1827] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:36 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:36.900864 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7d195611-610b-4458-a158-26876e43e303 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:36.901851 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7d195611-610b-4458-a158-26876e43e303 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:36.909167 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7d195611-610b-4458-a158-26876e43e303 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:36.909615 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7d195611-610b-4458-a158-26876e43e303 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:36.910410 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7d195611-610b-4458-a158-26876e43e303 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:36.910847 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7d195611-610b-4458-a158-26876e43e303 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:36.940148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7d195611-610b-4458-a158-26876e43e303 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043167 May 24 13:32:36.940711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 917/1828] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:37.900265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1cca519-1104-4ddd-a32e-f94de582c8c9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:37.900873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c1cca519-1104-4ddd-a32e-f94de582c8c9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:37.908350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1cca519-1104-4ddd-a32e-f94de582c8c9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:37.908860 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1cca519-1104-4ddd-a32e-f94de582c8c9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:37.909637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1cca519-1104-4ddd-a32e-f94de582c8c9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:37.910066 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1cca519-1104-4ddd-a32e-f94de582c8c9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:37.951353 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8d17df03-1470-4545-be9f-c6a005234249 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:37.953019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8d17df03-1470-4545-be9f-c6a005234249 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:37.959834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d17df03-1470-4545-be9f-c6a005234249 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:37.960656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d17df03-1470-4545-be9f-c6a005234249 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:37.961440 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d17df03-1470-4545-be9f-c6a005234249 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:37.961882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d17df03-1470-4545-be9f-c6a005234249 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:37.975472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c1cca519-1104-4ddd-a32e-f94de582c8c9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:37.985095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c1cca519-1104-4ddd-a32e-f94de582c8c9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1300 microversion: 2.1 time: 0.088442 May 24 13:32:37.986050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 912/1829] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:37 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:37.993576 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8d17df03-1470-4545-be9f-c6a005234249 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046259 May 24 13:32:37.994503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 918/1830] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:39.002061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dbd08b10-6df0-46f9-b585-a192735b5be4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:39.003386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dbd08b10-6df0-46f9-b585-a192735b5be4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:39.005388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b1d189ec-c009-43e0-9844-5f2bc9d21156 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:39.006500 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b1d189ec-c009-43e0-9844-5f2bc9d21156 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:39.012115 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbd08b10-6df0-46f9-b585-a192735b5be4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:39.013471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbd08b10-6df0-46f9-b585-a192735b5be4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:39.014372 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b1d189ec-c009-43e0-9844-5f2bc9d21156 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:39.014734 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbd08b10-6df0-46f9-b585-a192735b5be4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:39.015013 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b1d189ec-c009-43e0-9844-5f2bc9d21156 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:39.015177 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbd08b10-6df0-46f9-b585-a192735b5be4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:39.016127 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b1d189ec-c009-43e0-9844-5f2bc9d21156 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:39.016517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b1d189ec-c009-43e0-9844-5f2bc9d21156 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:39.060918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b1d189ec-c009-43e0-9844-5f2bc9d21156 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059911 May 24 13:32:39.061501 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 919/1831] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:32:39.203146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dbd08b10-6df0-46f9-b585-a192735b5be4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:39.212525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dbd08b10-6df0-46f9-b585-a192735b5be4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1367 microversion: 2.1 time: 0.214843 May 24 13:32:39.223487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 913/1832] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:38 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:39.228298 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-3d80cc79-01a6-45bc-94f6-862fd3911fb7 req-c2b03fdb-9384-4ccb-a0a9-47e760687804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50777b9e-1315-4cfc-a463-5a6fc3e6f6d3", "tag": "9ddc296f-d30c-480d-9e9d-26c55cbee4fa"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:32:39.236728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-3d80cc79-01a6-45bc-94f6-862fd3911fb7 req-c2b03fdb-9384-4ccb-a0a9-47e760687804 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:39.237166 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-3d80cc79-01a6-45bc-94f6-862fd3911fb7 req-c2b03fdb-9384-4ccb-a0a9-47e760687804 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:39.249533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-3d80cc79-01a6-45bc-94f6-862fd3911fb7 req-c2b03fdb-9384-4ccb-a0a9-47e760687804 service nova] Creating event network-changed:9ddc296f-d30c-480d-9e9d-26c55cbee4fa for instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 on hv-cinder-84301 May 24 13:32:39.255780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-3d80cc79-01a6-45bc-94f6-862fd3911fb7 req-c2b03fdb-9384-4ccb-a0a9-47e760687804 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142637 May 24 13:32:39.256659 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 920/1833] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:40.072575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bbea4d9a-76e1-4bc7-a5ef-b007e1ba1e54 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:40.073685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bbea4d9a-76e1-4bc7-a5ef-b007e1ba1e54 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:40.080819 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbea4d9a-76e1-4bc7-a5ef-b007e1ba1e54 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:40.081270 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbea4d9a-76e1-4bc7-a5ef-b007e1ba1e54 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:40.082022 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbea4d9a-76e1-4bc7-a5ef-b007e1ba1e54 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:40.082482 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbea4d9a-76e1-4bc7-a5ef-b007e1ba1e54 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:40.111079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bbea4d9a-76e1-4bc7-a5ef-b007e1ba1e54 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042445 May 24 13:32:40.111621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 914/1834] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:40.230024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-90014f51-4c59-4089-a3a1-e814257f3f50 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:40.231275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-90014f51-4c59-4089-a3a1-e814257f3f50 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:40.237398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90014f51-4c59-4089-a3a1-e814257f3f50 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:40.237843 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90014f51-4c59-4089-a3a1-e814257f3f50 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:40.238627 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90014f51-4c59-4089-a3a1-e814257f3f50 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:40.239061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-90014f51-4c59-4089-a3a1-e814257f3f50 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:40.364110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-90014f51-4c59-4089-a3a1-e814257f3f50 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:40.372027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-90014f51-4c59-4089-a3a1-e814257f3f50 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1367 microversion: 2.1 time: 0.146665 May 24 13:32:40.372583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 921/1835] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:40 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:41.123274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3bee0c9f-e30e-4b04-97fb-b4751eb32f31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:41.124202 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3bee0c9f-e30e-4b04-97fb-b4751eb32f31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:41.131156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bee0c9f-e30e-4b04-97fb-b4751eb32f31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:41.131613 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bee0c9f-e30e-4b04-97fb-b4751eb32f31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:41.132374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bee0c9f-e30e-4b04-97fb-b4751eb32f31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:41.132810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bee0c9f-e30e-4b04-97fb-b4751eb32f31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:41.161222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3bee0c9f-e30e-4b04-97fb-b4751eb32f31 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042601 May 24 13:32:41.161761 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 915/1836] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:41.388960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8cba5c4d-eff0-4318-a245-f3c2d4179f0f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:41.389486 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8cba5c4d-eff0-4318-a245-f3c2d4179f0f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:41.395951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8cba5c4d-eff0-4318-a245-f3c2d4179f0f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:41.396404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8cba5c4d-eff0-4318-a245-f3c2d4179f0f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:41.397164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8cba5c4d-eff0-4318-a245-f3c2d4179f0f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:41.397599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8cba5c4d-eff0-4318-a245-f3c2d4179f0f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:41.616328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8cba5c4d-eff0-4318-a245-f3c2d4179f0f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:41.623927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8cba5c4d-eff0-4318-a245-f3c2d4179f0f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1367 microversion: 2.1 time: 0.239140 May 24 13:32:41.624503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 922/1837] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:41 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:42.172735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2fe4cc44-45e3-410d-bfd8-90081ebbaf58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:42.173655 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2fe4cc44-45e3-410d-bfd8-90081ebbaf58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:42.180152 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2fe4cc44-45e3-410d-bfd8-90081ebbaf58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:42.180595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2fe4cc44-45e3-410d-bfd8-90081ebbaf58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:42.181349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2fe4cc44-45e3-410d-bfd8-90081ebbaf58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:42.181780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2fe4cc44-45e3-410d-bfd8-90081ebbaf58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:42.211135 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2fe4cc44-45e3-410d-bfd8-90081ebbaf58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042361 May 24 13:32:42.211680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 916/1838] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:42.640790 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6f564ade-4218-4336-a72a-7940212c6948 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:42.641413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6f564ade-4218-4336-a72a-7940212c6948 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:42.647878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f564ade-4218-4336-a72a-7940212c6948 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:42.648322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f564ade-4218-4336-a72a-7940212c6948 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:42.649073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f564ade-4218-4336-a72a-7940212c6948 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:42.649507 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f564ade-4218-4336-a72a-7940212c6948 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:42.773777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6f564ade-4218-4336-a72a-7940212c6948 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:42.781707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6f564ade-4218-4336-a72a-7940212c6948 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1367 microversion: 2.1 time: 0.144804 May 24 13:32:42.782263 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 923/1839] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:42 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:43.222139 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f8162723-6a7b-497e-a323-db001e1a5d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:43.223090 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f8162723-6a7b-497e-a323-db001e1a5d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:43.229810 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8162723-6a7b-497e-a323-db001e1a5d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:43.230776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8162723-6a7b-497e-a323-db001e1a5d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:43.231560 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8162723-6a7b-497e-a323-db001e1a5d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:43.231988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8162723-6a7b-497e-a323-db001e1a5d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:43.267173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f8162723-6a7b-497e-a323-db001e1a5d08 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048942 May 24 13:32:43.267717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 917/1840] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:43.799545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e0e9a715-b630-4b66-bc95-d80086800c86 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:43.800173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e0e9a715-b630-4b66-bc95-d80086800c86 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:43.806928 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e0e9a715-b630-4b66-bc95-d80086800c86 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:43.807387 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e0e9a715-b630-4b66-bc95-d80086800c86 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:43.808178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e0e9a715-b630-4b66-bc95-d80086800c86 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:43.808613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e0e9a715-b630-4b66-bc95-d80086800c86 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:43.951452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e0e9a715-b630-4b66-bc95-d80086800c86 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:43.959149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e0e9a715-b630-4b66-bc95-d80086800c86 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1367 microversion: 2.1 time: 0.163582 May 24 13:32:43.959720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 924/1841] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:43 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:44.277912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-28e98981-e630-4309-a359-b3ab1be5de85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:44.278875 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-28e98981-e630-4309-a359-b3ab1be5de85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:44.285534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28e98981-e630-4309-a359-b3ab1be5de85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:44.285983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28e98981-e630-4309-a359-b3ab1be5de85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:44.286781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28e98981-e630-4309-a359-b3ab1be5de85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:44.287210 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28e98981-e630-4309-a359-b3ab1be5de85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:44.316336 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-28e98981-e630-4309-a359-b3ab1be5de85 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042411 May 24 13:32:44.316884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 918/1842] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:44.976573 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b715008f-92ea-4547-9956-c062a21d11fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:44.977174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b715008f-92ea-4547-9956-c062a21d11fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:44.984143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b715008f-92ea-4547-9956-c062a21d11fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:44.984585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b715008f-92ea-4547-9956-c062a21d11fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:44.985336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b715008f-92ea-4547-9956-c062a21d11fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:44.985768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b715008f-92ea-4547-9956-c062a21d11fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:45.115249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b715008f-92ea-4547-9956-c062a21d11fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:45.122700 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b715008f-92ea-4547-9956-c062a21d11fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1367 microversion: 2.1 time: 0.150183 May 24 13:32:45.123279 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 925/1843] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:44 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:45.327994 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7372f2c6-3dfe-49c8-99eb-5451a3e3abc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:45.328926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7372f2c6-3dfe-49c8-99eb-5451a3e3abc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:45.335452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7372f2c6-3dfe-49c8-99eb-5451a3e3abc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:45.335906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7372f2c6-3dfe-49c8-99eb-5451a3e3abc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:45.336669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7372f2c6-3dfe-49c8-99eb-5451a3e3abc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:45.337111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7372f2c6-3dfe-49c8-99eb-5451a3e3abc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:45.367572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7372f2c6-3dfe-49c8-99eb-5451a3e3abc2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043610 May 24 13:32:45.368122 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 919/1844] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:45.796368 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-67063c9c-f13c-4c6b-a929-c767821cb9e0 req-457748c2-4c4a-4ad7-8006-726329ac96f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50777b9e-1315-4cfc-a463-5a6fc3e6f6d3", "name": "network-vif-plugged", "status": "completed", "tag": "9ddc296f-d30c-480d-9e9d-26c55cbee4fa"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:32:45.804535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-67063c9c-f13c-4c6b-a929-c767821cb9e0 req-457748c2-4c4a-4ad7-8006-726329ac96f7 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:45.804990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-67063c9c-f13c-4c6b-a929-c767821cb9e0 req-457748c2-4c4a-4ad7-8006-726329ac96f7 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:45.818648 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-67063c9c-f13c-4c6b-a929-c767821cb9e0 req-457748c2-4c4a-4ad7-8006-726329ac96f7 service nova] Creating event network-vif-plugged:9ddc296f-d30c-480d-9e9d-26c55cbee4fa for instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 on hv-cinder-84301 May 24 13:32:45.823491 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-67063c9c-f13c-4c6b-a929-c767821cb9e0 req-457748c2-4c4a-4ad7-8006-726329ac96f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080659 May 24 13:32:45.824753 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 926/1845] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:46.139044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0dc73d3d-46fa-40c8-8b37-2725f519f050 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:46.139580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0dc73d3d-46fa-40c8-8b37-2725f519f050 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:46.145581 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dc73d3d-46fa-40c8-8b37-2725f519f050 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:46.146035 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dc73d3d-46fa-40c8-8b37-2725f519f050 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:46.146840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dc73d3d-46fa-40c8-8b37-2725f519f050 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:46.147285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dc73d3d-46fa-40c8-8b37-2725f519f050 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:46.276351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0dc73d3d-46fa-40c8-8b37-2725f519f050 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:46.283766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0dc73d3d-46fa-40c8-8b37-2725f519f050 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1367 microversion: 2.1 time: 0.149393 May 24 13:32:46.284365 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 920/1846] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:46 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:46.379947 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d0cb83cc-d4d7-4bee-85a4-6aff257e684b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:46.380951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d0cb83cc-d4d7-4bee-85a4-6aff257e684b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:46.387305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0cb83cc-d4d7-4bee-85a4-6aff257e684b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:46.387755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0cb83cc-d4d7-4bee-85a4-6aff257e684b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:46.388517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0cb83cc-d4d7-4bee-85a4-6aff257e684b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:46.388953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0cb83cc-d4d7-4bee-85a4-6aff257e684b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:46.418575 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d0cb83cc-d4d7-4bee-85a4-6aff257e684b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043207 May 24 13:32:46.419132 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 927/1847] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:32:47.300733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-45eb5e46-80e1-4dc4-bc6c-1d94876025a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:47.301929 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-45eb5e46-80e1-4dc4-bc6c-1d94876025a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:47.305569 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:47.311763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45eb5e46-80e1-4dc4-bc6c-1d94876025a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:47.312314 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45eb5e46-80e1-4dc4-bc6c-1d94876025a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:47.313093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45eb5e46-80e1-4dc4-bc6c-1d94876025a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:47.313525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45eb5e46-80e1-4dc4-bc6c-1d94876025a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:47.430212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-81165b3e-5f4e-4843-9e16-dbea47908cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:47.431185 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-81165b3e-5f4e-4843-9e16-dbea47908cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:47.433658 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:47.434345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=6 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:47.441188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-81165b3e-5f4e-4843-9e16-dbea47908cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:47.441698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-81165b3e-5f4e-4843-9e16-dbea47908cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:47.441956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-45eb5e46-80e1-4dc4-bc6c-1d94876025a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:47.442496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-81165b3e-5f4e-4843-9e16-dbea47908cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:47.443097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-81165b3e-5f4e-4843-9e16-dbea47908cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:47.450031 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-45eb5e46-80e1-4dc4-bc6c-1d94876025a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1367 microversion: 2.1 time: 0.153057 May 24 13:32:47.450649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 921/1848] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:47 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:47.473961 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-81165b3e-5f4e-4843-9e16-dbea47908cee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047511 May 24 13:32:47.474544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 928/1849] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:32:48.467373 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9fcf1fbf-8fc5-40e5-8c89-da2adb97ce61 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:48.467994 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9fcf1fbf-8fc5-40e5-8c89-da2adb97ce61 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:48.474811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fcf1fbf-8fc5-40e5-8c89-da2adb97ce61 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:48.475265 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fcf1fbf-8fc5-40e5-8c89-da2adb97ce61 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:48.476029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fcf1fbf-8fc5-40e5-8c89-da2adb97ce61 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:48.476468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fcf1fbf-8fc5-40e5-8c89-da2adb97ce61 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:48.484898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9b403dfc-01d5-4908-aeba-cdaed5913739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:48.485818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9b403dfc-01d5-4908-aeba-cdaed5913739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:48.492398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b403dfc-01d5-4908-aeba-cdaed5913739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:48.492859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b403dfc-01d5-4908-aeba-cdaed5913739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:48.493598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b403dfc-01d5-4908-aeba-cdaed5913739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:48.494038 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b403dfc-01d5-4908-aeba-cdaed5913739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:48.532454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9b403dfc-01d5-4908-aeba-cdaed5913739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051356 May 24 13:32:48.533022 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 929/1850] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:32:48.605999 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9fcf1fbf-8fc5-40e5-8c89-da2adb97ce61 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:32:48.613703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9fcf1fbf-8fc5-40e5-8c89-da2adb97ce61 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1557 microversion: 2.1 time: 0.150877 May 24 13:32:48.614300 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 922/1851] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:32:48 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:32:48.629584 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0965dc3b-7c01-46d7-94c9-3ed45d829321 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:48.630151 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0965dc3b-7c01-46d7-94c9-3ed45d829321 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:48.636649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0965dc3b-7c01-46d7-94c9-3ed45d829321 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:48.637099 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0965dc3b-7c01-46d7-94c9-3ed45d829321 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:48.638028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0965dc3b-7c01-46d7-94c9-3ed45d829321 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:48.638483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0965dc3b-7c01-46d7-94c9-3ed45d829321 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:48.724985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0965dc3b-7c01-46d7-94c9-3ed45d829321 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096188 May 24 13:32:48.725596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 930/1852] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 13:32:48 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:49.544023 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dacd778e-ca23-41a4-b37b-ebdfdae6c9fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:49.544952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dacd778e-ca23-41a4-b37b-ebdfdae6c9fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:49.551538 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dacd778e-ca23-41a4-b37b-ebdfdae6c9fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:49.551987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dacd778e-ca23-41a4-b37b-ebdfdae6c9fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:49.552758 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dacd778e-ca23-41a4-b37b-ebdfdae6c9fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:49.553189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dacd778e-ca23-41a4-b37b-ebdfdae6c9fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:49.601707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dacd778e-ca23-41a4-b37b-ebdfdae6c9fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062230 May 24 13:32:49.606418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 923/1853] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:49.614569 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-eb88a09b-bff3-4388-b5de-f7226e91c216 req-4eef73d6-2947-41b3-b407-a718c73f6624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50777b9e-1315-4cfc-a463-5a6fc3e6f6d3", "tag": "9ddc296f-d30c-480d-9e9d-26c55cbee4fa"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:32:49.622724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-eb88a09b-bff3-4388-b5de-f7226e91c216 req-4eef73d6-2947-41b3-b407-a718c73f6624 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:49.623266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-eb88a09b-bff3-4388-b5de-f7226e91c216 req-4eef73d6-2947-41b3-b407-a718c73f6624 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:49.634362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-eb88a09b-bff3-4388-b5de-f7226e91c216 req-4eef73d6-2947-41b3-b407-a718c73f6624 service nova] Creating event network-changed:9ddc296f-d30c-480d-9e9d-26c55cbee4fa for instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 on hv-cinder-84301 May 24 13:32:49.642823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-eb88a09b-bff3-4388-b5de-f7226e91c216 req-4eef73d6-2947-41b3-b407-a718c73f6624 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032325 May 24 13:32:49.643518 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 931/1854] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:32:50.613085 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0b121803-3060-405c-b91f-b38474dfb641 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:50.614013 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0b121803-3060-405c-b91f-b38474dfb641 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:50.621074 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b121803-3060-405c-b91f-b38474dfb641 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:50.621525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b121803-3060-405c-b91f-b38474dfb641 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:50.622345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b121803-3060-405c-b91f-b38474dfb641 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:50.622788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b121803-3060-405c-b91f-b38474dfb641 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:50.652291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0b121803-3060-405c-b91f-b38474dfb641 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043131 May 24 13:32:50.652851 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 924/1855] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:51.665320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-27d77ff9-10d5-4568-95c2-8244384ad4e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:51.666243 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-27d77ff9-10d5-4568-95c2-8244384ad4e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:51.672496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-27d77ff9-10d5-4568-95c2-8244384ad4e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:51.672941 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-27d77ff9-10d5-4568-95c2-8244384ad4e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:51.673696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-27d77ff9-10d5-4568-95c2-8244384ad4e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:51.674124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-27d77ff9-10d5-4568-95c2-8244384ad4e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:51.703372 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-27d77ff9-10d5-4568-95c2-8244384ad4e5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043245 May 24 13:32:51.703938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 932/1856] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:52.715064 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ba784d1c-6bd8-4be7-b432-254b2b109739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:52.716011 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ba784d1c-6bd8-4be7-b432-254b2b109739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:52.723211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba784d1c-6bd8-4be7-b432-254b2b109739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:52.723927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba784d1c-6bd8-4be7-b432-254b2b109739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:52.724678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba784d1c-6bd8-4be7-b432-254b2b109739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:52.725105 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba784d1c-6bd8-4be7-b432-254b2b109739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:52.727435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:52.754780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ba784d1c-6bd8-4be7-b432-254b2b109739 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043649 May 24 13:32:52.755321 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 925/1857] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:53.766897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ba042553-b3d9-4dbe-a5ba-ac2de46b7307 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:53.767819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ba042553-b3d9-4dbe-a5ba-ac2de46b7307 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:53.774890 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ba042553-b3d9-4dbe-a5ba-ac2de46b7307 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:53.775345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ba042553-b3d9-4dbe-a5ba-ac2de46b7307 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:53.776115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ba042553-b3d9-4dbe-a5ba-ac2de46b7307 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:53.777430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ba042553-b3d9-4dbe-a5ba-ac2de46b7307 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:53.801982 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=100 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:32:53.807204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ba042553-b3d9-4dbe-a5ba-ac2de46b7307 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044334 May 24 13:32:53.807776 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 933/1858] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:54.819194 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a4d64d8d-d6fe-4c49-a11d-caaf559307d2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:54.820120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a4d64d8d-d6fe-4c49-a11d-caaf559307d2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:54.827297 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4d64d8d-d6fe-4c49-a11d-caaf559307d2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:54.827751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4d64d8d-d6fe-4c49-a11d-caaf559307d2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:54.828514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4d64d8d-d6fe-4c49-a11d-caaf559307d2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:54.828957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a4d64d8d-d6fe-4c49-a11d-caaf559307d2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:54.859462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a4d64d8d-d6fe-4c49-a11d-caaf559307d2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044226 May 24 13:32:54.860013 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 926/1859] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:55.871854 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f149df05-0be3-439b-a5fc-47f740daef3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:55.872788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f149df05-0be3-439b-a5fc-47f740daef3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:55.879328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f149df05-0be3-439b-a5fc-47f740daef3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:55.879775 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f149df05-0be3-439b-a5fc-47f740daef3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:55.880529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f149df05-0be3-439b-a5fc-47f740daef3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:55.880964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f149df05-0be3-439b-a5fc-47f740daef3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:55.909961 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f149df05-0be3-439b-a5fc-47f740daef3b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042913 May 24 13:32:55.910529 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 934/1860] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:56.921450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9ca207f1-c36c-41ea-b59e-4c67c0fea234 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:56.922395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9ca207f1-c36c-41ea-b59e-4c67c0fea234 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:56.928527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ca207f1-c36c-41ea-b59e-4c67c0fea234 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:56.928973 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ca207f1-c36c-41ea-b59e-4c67c0fea234 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:56.929725 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ca207f1-c36c-41ea-b59e-4c67c0fea234 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:56.930154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ca207f1-c36c-41ea-b59e-4c67c0fea234 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:56.958776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9ca207f1-c36c-41ea-b59e-4c67c0fea234 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041372 May 24 13:32:56.959301 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 927/1861] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:57.971069 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-fe8f5017-2a1f-4698-b230-9d624b9e80ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:57.971987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-fe8f5017-2a1f-4698-b230-9d624b9e80ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:57.978523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fe8f5017-2a1f-4698-b230-9d624b9e80ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:57.978972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fe8f5017-2a1f-4698-b230-9d624b9e80ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:57.980422 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fe8f5017-2a1f-4698-b230-9d624b9e80ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:57.980857 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-fe8f5017-2a1f-4698-b230-9d624b9e80ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:58.009102 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-fe8f5017-2a1f-4698-b230-9d624b9e80ff tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042311 May 24 13:32:58.009651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 935/1862] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:32:59.020652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c993f252-b799-4b22-b034-8d40ddd045ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:32:59.021527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c993f252-b799-4b22-b034-8d40ddd045ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:32:59.028706 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c993f252-b799-4b22-b034-8d40ddd045ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:59.029156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c993f252-b799-4b22-b034-8d40ddd045ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:59.029914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c993f252-b799-4b22-b034-8d40ddd045ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:32:59.030375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c993f252-b799-4b22-b034-8d40ddd045ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:32:59.059125 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c993f252-b799-4b22-b034-8d40ddd045ec tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042560 May 24 13:32:59.059662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 928/1863] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:32:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:00.070957 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3c952df9-9af4-4883-a814-0e5aa78e3dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:00.071875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3c952df9-9af4-4883-a814-0e5aa78e3dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:00.078348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3c952df9-9af4-4883-a814-0e5aa78e3dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:00.078797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3c952df9-9af4-4883-a814-0e5aa78e3dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:00.079555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3c952df9-9af4-4883-a814-0e5aa78e3dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:00.079992 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3c952df9-9af4-4883-a814-0e5aa78e3dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:00.110585 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3c952df9-9af4-4883-a814-0e5aa78e3dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043831 May 24 13:33:00.111131 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 936/1864] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:01.122854 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0b94c2da-d59e-46a0-b0fd-38465fdf781d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:01.123772 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0b94c2da-d59e-46a0-b0fd-38465fdf781d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:01.130249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b94c2da-d59e-46a0-b0fd-38465fdf781d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:01.130724 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b94c2da-d59e-46a0-b0fd-38465fdf781d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:01.131480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b94c2da-d59e-46a0-b0fd-38465fdf781d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:01.131941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b94c2da-d59e-46a0-b0fd-38465fdf781d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:01.160621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0b94c2da-d59e-46a0-b0fd-38465fdf781d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042502 May 24 13:33:01.161157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 929/1865] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:02.172702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b82a154e-4eea-47ef-b907-38ece2205445 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:02.173624 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b82a154e-4eea-47ef-b907-38ece2205445 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:02.180155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b82a154e-4eea-47ef-b907-38ece2205445 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:02.180608 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b82a154e-4eea-47ef-b907-38ece2205445 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:02.181364 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b82a154e-4eea-47ef-b907-38ece2205445 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:02.181802 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b82a154e-4eea-47ef-b907-38ece2205445 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:02.210641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b82a154e-4eea-47ef-b907-38ece2205445 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041923 May 24 13:33:02.211189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 937/1866] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:03.222181 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8d7b34bd-d653-4ad9-8db6-b1b40484fc89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:03.223051 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8d7b34bd-d653-4ad9-8db6-b1b40484fc89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:03.225562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:33:03.230975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d7b34bd-d653-4ad9-8db6-b1b40484fc89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:03.231423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d7b34bd-d653-4ad9-8db6-b1b40484fc89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:03.232179 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d7b34bd-d653-4ad9-8db6-b1b40484fc89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:03.232606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d7b34bd-d653-4ad9-8db6-b1b40484fc89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:03.263712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8d7b34bd-d653-4ad9-8db6-b1b40484fc89 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045543 May 24 13:33:03.264244 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 930/1867] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:04.275221 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-04057723-8206-4920-922d-3d6fe160f824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:04.276136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-04057723-8206-4920-922d-3d6fe160f824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:04.278451 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:33:04.283834 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04057723-8206-4920-922d-3d6fe160f824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:04.284282 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04057723-8206-4920-922d-3d6fe160f824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:04.285033 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04057723-8206-4920-922d-3d6fe160f824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:04.285465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-04057723-8206-4920-922d-3d6fe160f824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:04.316881 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-04057723-8206-4920-922d-3d6fe160f824 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045785 May 24 13:33:04.317430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 938/1868] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:05.328977 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9d9bd440-14cc-44fc-b644-8fa7dd233bfb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:05.329910 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9d9bd440-14cc-44fc-b644-8fa7dd233bfb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:05.336520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d9bd440-14cc-44fc-b644-8fa7dd233bfb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:05.336966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d9bd440-14cc-44fc-b644-8fa7dd233bfb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:05.337723 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d9bd440-14cc-44fc-b644-8fa7dd233bfb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:05.338155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d9bd440-14cc-44fc-b644-8fa7dd233bfb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:05.366610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9d9bd440-14cc-44fc-b644-8fa7dd233bfb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041559 May 24 13:33:05.367138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 931/1869] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:06.378778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0a0a08a2-c48f-436b-9fe2-b178fa7289fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:06.379710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0a0a08a2-c48f-436b-9fe2-b178fa7289fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:06.386994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0a0a08a2-c48f-436b-9fe2-b178fa7289fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:06.387452 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0a0a08a2-c48f-436b-9fe2-b178fa7289fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:06.388228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0a0a08a2-c48f-436b-9fe2-b178fa7289fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:06.388670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0a0a08a2-c48f-436b-9fe2-b178fa7289fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:06.419412 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0a0a08a2-c48f-436b-9fe2-b178fa7289fa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044608 May 24 13:33:06.419980 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 939/1870] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:07.431028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60cd2cbe-4018-4f1f-8e6f-caf8cc053511 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:07.431953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60cd2cbe-4018-4f1f-8e6f-caf8cc053511 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:07.439124 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60cd2cbe-4018-4f1f-8e6f-caf8cc053511 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:07.439572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60cd2cbe-4018-4f1f-8e6f-caf8cc053511 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:07.440322 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60cd2cbe-4018-4f1f-8e6f-caf8cc053511 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:07.440752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60cd2cbe-4018-4f1f-8e6f-caf8cc053511 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:07.468921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60cd2cbe-4018-4f1f-8e6f-caf8cc053511 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041867 May 24 13:33:07.469449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 932/1871] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:08.480226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-10634903-ed0c-45bd-bdba-5e7ec12c7ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:08.481162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-10634903-ed0c-45bd-bdba-5e7ec12c7ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:08.487732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10634903-ed0c-45bd-bdba-5e7ec12c7ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:08.488183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10634903-ed0c-45bd-bdba-5e7ec12c7ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:08.488943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10634903-ed0c-45bd-bdba-5e7ec12c7ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:08.489381 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-10634903-ed0c-45bd-bdba-5e7ec12c7ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:08.520603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-10634903-ed0c-45bd-bdba-5e7ec12c7ce5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044286 May 24 13:33:08.521164 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 940/1872] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:09.532752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-59440e83-c44e-415b-811a-81e673ee526f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:09.533705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-59440e83-c44e-415b-811a-81e673ee526f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:09.540285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59440e83-c44e-415b-811a-81e673ee526f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:09.540736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59440e83-c44e-415b-811a-81e673ee526f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:09.541494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59440e83-c44e-415b-811a-81e673ee526f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:09.541928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59440e83-c44e-415b-811a-81e673ee526f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:09.570278 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-59440e83-c44e-415b-811a-81e673ee526f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041526 May 24 13:33:09.570836 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 933/1873] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:10.582322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bfc97974-ba65-4e2c-baf4-a685216dd571 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:10.583247 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bfc97974-ba65-4e2c-baf4-a685216dd571 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:10.590135 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bfc97974-ba65-4e2c-baf4-a685216dd571 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:10.590613 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bfc97974-ba65-4e2c-baf4-a685216dd571 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:10.591368 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bfc97974-ba65-4e2c-baf4-a685216dd571 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:10.591801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bfc97974-ba65-4e2c-baf4-a685216dd571 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:10.621057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bfc97974-ba65-4e2c-baf4-a685216dd571 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042741 May 24 13:33:10.621591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 941/1874] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:11.632683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3b101726-a896-4f2a-980a-bbf37a3134d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:11.633602 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3b101726-a896-4f2a-980a-bbf37a3134d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:11.640714 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3b101726-a896-4f2a-980a-bbf37a3134d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:11.641161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3b101726-a896-4f2a-980a-bbf37a3134d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:11.641914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3b101726-a896-4f2a-980a-bbf37a3134d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:11.642376 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3b101726-a896-4f2a-980a-bbf37a3134d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:11.670930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3b101726-a896-4f2a-980a-bbf37a3134d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042194 May 24 13:33:11.671400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 934/1875] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:12.683072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-24dd5c9f-3e29-4daf-9bf4-1d82ab14a85b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:12.683928 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-24dd5c9f-3e29-4daf-9bf4-1d82ab14a85b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:12.690415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24dd5c9f-3e29-4daf-9bf4-1d82ab14a85b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:12.690865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24dd5c9f-3e29-4daf-9bf4-1d82ab14a85b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:12.691621 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24dd5c9f-3e29-4daf-9bf4-1d82ab14a85b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:12.692052 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24dd5c9f-3e29-4daf-9bf4-1d82ab14a85b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:12.720290 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-24dd5c9f-3e29-4daf-9bf4-1d82ab14a85b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041915 May 24 13:33:12.720831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 942/1876] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:13.732300 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0575630e-91d1-4586-903b-c781bcc58bd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:13.733138 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0575630e-91d1-4586-903b-c781bcc58bd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:13.739606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0575630e-91d1-4586-903b-c781bcc58bd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:13.740056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0575630e-91d1-4586-903b-c781bcc58bd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:13.740816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0575630e-91d1-4586-903b-c781bcc58bd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:13.741255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0575630e-91d1-4586-903b-c781bcc58bd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:13.770674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0575630e-91d1-4586-903b-c781bcc58bd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042543 May 24 13:33:13.771222 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 935/1877] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:14.782303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-73238f8d-c882-48e7-8f13-ae417160cc1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:14.783161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-73238f8d-c882-48e7-8f13-ae417160cc1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:14.789618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73238f8d-c882-48e7-8f13-ae417160cc1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:14.790072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73238f8d-c882-48e7-8f13-ae417160cc1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:14.790878 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73238f8d-c882-48e7-8f13-ae417160cc1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:14.791323 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73238f8d-c882-48e7-8f13-ae417160cc1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:14.821094 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-73238f8d-c882-48e7-8f13-ae417160cc1d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042906 May 24 13:33:14.821632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 943/1878] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:15.832262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b1b8dbc7-f082-41f0-814c-9ca1dddff0be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:15.833181 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b1b8dbc7-f082-41f0-814c-9ca1dddff0be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:15.839668 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1b8dbc7-f082-41f0-814c-9ca1dddff0be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:15.840111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1b8dbc7-f082-41f0-814c-9ca1dddff0be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:15.840857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1b8dbc7-f082-41f0-814c-9ca1dddff0be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:15.841284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1b8dbc7-f082-41f0-814c-9ca1dddff0be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:15.870718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b1b8dbc7-f082-41f0-814c-9ca1dddff0be tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042340 May 24 13:33:15.871256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 936/1879] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:16.882888 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d8235a3c-1334-4e52-b55c-5d2ef0408161 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:16.883818 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d8235a3c-1334-4e52-b55c-5d2ef0408161 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:16.890976 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d8235a3c-1334-4e52-b55c-5d2ef0408161 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:16.891432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d8235a3c-1334-4e52-b55c-5d2ef0408161 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:16.892195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d8235a3c-1334-4e52-b55c-5d2ef0408161 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:16.892634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d8235a3c-1334-4e52-b55c-5d2ef0408161 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:16.922628 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d8235a3c-1334-4e52-b55c-5d2ef0408161 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043760 May 24 13:33:16.923173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 944/1880] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:17.933785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-61e07763-4bae-443e-b1b1-51df19e359f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:17.934765 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-61e07763-4bae-443e-b1b1-51df19e359f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:17.941190 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61e07763-4bae-443e-b1b1-51df19e359f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:17.941636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61e07763-4bae-443e-b1b1-51df19e359f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:17.942414 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61e07763-4bae-443e-b1b1-51df19e359f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:17.942847 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61e07763-4bae-443e-b1b1-51df19e359f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:17.972182 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-61e07763-4bae-443e-b1b1-51df19e359f3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042360 May 24 13:33:17.972713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 937/1881] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:18.984649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9642b6e6-430b-413c-9b59-e41bad6ec687 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:18.985576 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9642b6e6-430b-413c-9b59-e41bad6ec687 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:18.992161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9642b6e6-430b-413c-9b59-e41bad6ec687 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:18.992639 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9642b6e6-430b-413c-9b59-e41bad6ec687 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:18.993398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9642b6e6-430b-413c-9b59-e41bad6ec687 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:18.993836 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9642b6e6-430b-413c-9b59-e41bad6ec687 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:19.034723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9642b6e6-430b-413c-9b59-e41bad6ec687 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053968 May 24 13:33:19.035329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 945/1882] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:20.046757 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-38d0d02b-51d0-4008-a98f-2e34e9031a4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:20.047672 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-38d0d02b-51d0-4008-a98f-2e34e9031a4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:20.054108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38d0d02b-51d0-4008-a98f-2e34e9031a4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:20.054586 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38d0d02b-51d0-4008-a98f-2e34e9031a4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:20.055341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38d0d02b-51d0-4008-a98f-2e34e9031a4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:20.055774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38d0d02b-51d0-4008-a98f-2e34e9031a4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:20.084713 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-38d0d02b-51d0-4008-a98f-2e34e9031a4f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042071 May 24 13:33:20.085256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 938/1883] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:20.949450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:33:20.949709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:33:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:33:21.097162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c14ee3e4-14ab-4ebe-9455-504f815e942b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:21.098406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c14ee3e4-14ab-4ebe-9455-504f815e942b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:21.104943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c14ee3e4-14ab-4ebe-9455-504f815e942b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:21.105400 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c14ee3e4-14ab-4ebe-9455-504f815e942b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:21.106170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c14ee3e4-14ab-4ebe-9455-504f815e942b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:21.106644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c14ee3e4-14ab-4ebe-9455-504f815e942b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:21.136575 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c14ee3e4-14ab-4ebe-9455-504f815e942b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043402 May 24 13:33:21.137124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 946/1884] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:22.147766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7507f810-0195-4d53-b78c-4524f78f475c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:22.148684 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7507f810-0195-4d53-b78c-4524f78f475c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:22.156627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7507f810-0195-4d53-b78c-4524f78f475c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:22.156984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7507f810-0195-4d53-b78c-4524f78f475c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:22.157750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7507f810-0195-4d53-b78c-4524f78f475c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:22.158182 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7507f810-0195-4d53-b78c-4524f78f475c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:22.187798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7507f810-0195-4d53-b78c-4524f78f475c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043944 May 24 13:33:22.188339 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 939/1885] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:23.199489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7ddcb395-dfec-4ca8-8c68-fb0a28947b3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:23.200409 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7ddcb395-dfec-4ca8-8c68-fb0a28947b3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:23.206844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ddcb395-dfec-4ca8-8c68-fb0a28947b3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:23.207297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ddcb395-dfec-4ca8-8c68-fb0a28947b3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:23.208054 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ddcb395-dfec-4ca8-8c68-fb0a28947b3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:23.208490 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7ddcb395-dfec-4ca8-8c68-fb0a28947b3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:23.237755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7ddcb395-dfec-4ca8-8c68-fb0a28947b3c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042186 May 24 13:33:23.238304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 947/1886] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:24.249705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d4651c25-b286-49b8-a23b-ce0a461421d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:24.250566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d4651c25-b286-49b8-a23b-ce0a461421d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:24.257116 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d4651c25-b286-49b8-a23b-ce0a461421d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:24.257576 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d4651c25-b286-49b8-a23b-ce0a461421d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:24.258355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d4651c25-b286-49b8-a23b-ce0a461421d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:24.258795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d4651c25-b286-49b8-a23b-ce0a461421d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:24.261805 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:33:24.288613 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d4651c25-b286-49b8-a23b-ce0a461421d8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042975 May 24 13:33:24.289156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 940/1887] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:24.694267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e4154c31-0e52-4f37-9588-a6842419af1a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] Calling method '.version_select at 0x7f9a6b97cb80>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:24.714617 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e4154c31-0e52-4f37-9588-a6842419af1a tempest-TestVolumeBootPattern-1193829736 tempest-TestVolumeBootPattern-1193829736-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1349995211" status: 202 len: 0 microversion: 2.1 time: 0.024581 May 24 13:33:24.715212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 948/1888] 10.222.0.45 () {58 vars in 1262 bytes} [Tue May 24 13:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1349995211 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:33:25.300302 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-885e306a-ae84-4955-972b-e9e9d2f78d53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:25.301291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-885e306a-ae84-4955-972b-e9e9d2f78d53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:25.307762 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885e306a-ae84-4955-972b-e9e9d2f78d53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:25.308215 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885e306a-ae84-4955-972b-e9e9d2f78d53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:25.308991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885e306a-ae84-4955-972b-e9e9d2f78d53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:25.309428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885e306a-ae84-4955-972b-e9e9d2f78d53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:25.340642 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-885e306a-ae84-4955-972b-e9e9d2f78d53 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044414 May 24 13:33:25.341202 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 941/1889] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:26.353037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3332e958-7bb8-4dda-8c78-0c3c573b7bf6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:26.354621 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3332e958-7bb8-4dda-8c78-0c3c573b7bf6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:26.361436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3332e958-7bb8-4dda-8c78-0c3c573b7bf6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:26.361887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3332e958-7bb8-4dda-8c78-0c3c573b7bf6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:26.362692 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3332e958-7bb8-4dda-8c78-0c3c573b7bf6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:26.363128 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3332e958-7bb8-4dda-8c78-0c3c573b7bf6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:26.366723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=86 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:33:26.393526 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3332e958-7bb8-4dda-8c78-0c3c573b7bf6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045243 May 24 13:33:26.394081 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 949/1890] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:27.405079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f5484f7b-ebe3-4ceb-8639-4d81f75fb95f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:27.407527 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f5484f7b-ebe3-4ceb-8639-4d81f75fb95f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:27.414610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5484f7b-ebe3-4ceb-8639-4d81f75fb95f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:27.415304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5484f7b-ebe3-4ceb-8639-4d81f75fb95f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:27.417104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5484f7b-ebe3-4ceb-8639-4d81f75fb95f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:27.418231 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5484f7b-ebe3-4ceb-8639-4d81f75fb95f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:27.451224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f5484f7b-ebe3-4ceb-8639-4d81f75fb95f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050024 May 24 13:33:27.452108 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 942/1891] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:28.463270 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2ba90e58-c598-4398-b655-874fd918288b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:28.464873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2ba90e58-c598-4398-b655-874fd918288b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:28.472533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ba90e58-c598-4398-b655-874fd918288b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:28.473331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ba90e58-c598-4398-b655-874fd918288b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:28.474176 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ba90e58-c598-4398-b655-874fd918288b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:28.474904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2ba90e58-c598-4398-b655-874fd918288b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:28.508260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2ba90e58-c598-4398-b655-874fd918288b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048865 May 24 13:33:28.508768 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 950/1892] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:29.519968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c638d411-04fc-4fda-a3ed-49332d6d0dab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:29.520912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c638d411-04fc-4fda-a3ed-49332d6d0dab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:29.528196 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c638d411-04fc-4fda-a3ed-49332d6d0dab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:29.528650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c638d411-04fc-4fda-a3ed-49332d6d0dab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:29.529431 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c638d411-04fc-4fda-a3ed-49332d6d0dab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:29.529869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c638d411-04fc-4fda-a3ed-49332d6d0dab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:29.568320 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c638d411-04fc-4fda-a3ed-49332d6d0dab tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052152 May 24 13:33:29.570632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 943/1893] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:30.581460 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-084f503d-3660-4001-a63f-b1f05a991c7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:30.582649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-084f503d-3660-4001-a63f-b1f05a991c7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:30.590691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-084f503d-3660-4001-a63f-b1f05a991c7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:30.591415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-084f503d-3660-4001-a63f-b1f05a991c7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:30.592421 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-084f503d-3660-4001-a63f-b1f05a991c7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:30.593095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-084f503d-3660-4001-a63f-b1f05a991c7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:30.634246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-084f503d-3660-4001-a63f-b1f05a991c7e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056966 May 24 13:33:30.635702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 951/1894] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:31.646507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7820f9be-c6cc-4386-87af-899ae9a3170f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:31.647438 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7820f9be-c6cc-4386-87af-899ae9a3170f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:31.654037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7820f9be-c6cc-4386-87af-899ae9a3170f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:31.654536 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7820f9be-c6cc-4386-87af-899ae9a3170f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:31.655311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7820f9be-c6cc-4386-87af-899ae9a3170f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:31.655747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7820f9be-c6cc-4386-87af-899ae9a3170f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:31.686471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7820f9be-c6cc-4386-87af-899ae9a3170f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043832 May 24 13:33:31.687033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 944/1895] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:32.697375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7a0972dd-04c3-48b4-a3e0-be111a93717c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:32.698239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7a0972dd-04c3-48b4-a3e0-be111a93717c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:32.704721 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7a0972dd-04c3-48b4-a3e0-be111a93717c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:32.705162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7a0972dd-04c3-48b4-a3e0-be111a93717c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:32.705920 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7a0972dd-04c3-48b4-a3e0-be111a93717c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:32.706390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7a0972dd-04c3-48b4-a3e0-be111a93717c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:32.735446 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7a0972dd-04c3-48b4-a3e0-be111a93717c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042178 May 24 13:33:32.735998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 952/1896] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:33.747514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-32148ac9-b260-4a29-aa36-8c3c75aa5dfd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:33.748353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-32148ac9-b260-4a29-aa36-8c3c75aa5dfd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:33.750672 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:33:33.755876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32148ac9-b260-4a29-aa36-8c3c75aa5dfd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:33.756329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32148ac9-b260-4a29-aa36-8c3c75aa5dfd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:33.757089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32148ac9-b260-4a29-aa36-8c3c75aa5dfd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:33.757522 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32148ac9-b260-4a29-aa36-8c3c75aa5dfd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:33.786635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-32148ac9-b260-4a29-aa36-8c3c75aa5dfd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043680 May 24 13:33:33.787174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 945/1897] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:34.798847 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8e291b0c-22e5-415e-92fc-823ca226e85f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:34.799690 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8e291b0c-22e5-415e-92fc-823ca226e85f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:34.801970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:33:34.807288 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8e291b0c-22e5-415e-92fc-823ca226e85f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:34.807741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8e291b0c-22e5-415e-92fc-823ca226e85f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:34.808498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8e291b0c-22e5-415e-92fc-823ca226e85f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:34.808937 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8e291b0c-22e5-415e-92fc-823ca226e85f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:34.839051 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8e291b0c-22e5-415e-92fc-823ca226e85f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043706 May 24 13:33:34.839656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 953/1898] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:35.850325 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dcdb5a16-73d0-4468-88fe-e3166c3a98b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:35.851246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dcdb5a16-73d0-4468-88fe-e3166c3a98b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:35.857892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcdb5a16-73d0-4468-88fe-e3166c3a98b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:35.858382 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcdb5a16-73d0-4468-88fe-e3166c3a98b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:35.859159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcdb5a16-73d0-4468-88fe-e3166c3a98b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:35.859595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcdb5a16-73d0-4468-88fe-e3166c3a98b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:35.888796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dcdb5a16-73d0-4468-88fe-e3166c3a98b0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042730 May 24 13:33:35.889343 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 946/1899] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:36.900466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-54fa15a3-568b-44da-bfdc-8758a6834847 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:36.901402 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-54fa15a3-568b-44da-bfdc-8758a6834847 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:36.907934 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-54fa15a3-568b-44da-bfdc-8758a6834847 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:36.908390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-54fa15a3-568b-44da-bfdc-8758a6834847 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:36.909154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-54fa15a3-568b-44da-bfdc-8758a6834847 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:36.909599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-54fa15a3-568b-44da-bfdc-8758a6834847 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:36.939431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-54fa15a3-568b-44da-bfdc-8758a6834847 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042905 May 24 13:33:36.939996 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 954/1900] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:37.952185 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-45604251-4884-4212-bb97-b4ee71a9f5ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:37.953111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-45604251-4884-4212-bb97-b4ee71a9f5ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:37.960323 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45604251-4884-4212-bb97-b4ee71a9f5ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:37.960773 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45604251-4884-4212-bb97-b4ee71a9f5ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:37.961529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45604251-4884-4212-bb97-b4ee71a9f5ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:37.961964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45604251-4884-4212-bb97-b4ee71a9f5ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:37.991293 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-45604251-4884-4212-bb97-b4ee71a9f5ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044096 May 24 13:33:37.991837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 947/1901] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:39.003075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-93ac1e64-49f3-4f4e-a09a-0bf1e9982d88 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:39.004011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-93ac1e64-49f3-4f4e-a09a-0bf1e9982d88 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:39.011564 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93ac1e64-49f3-4f4e-a09a-0bf1e9982d88 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:39.012025 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93ac1e64-49f3-4f4e-a09a-0bf1e9982d88 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:39.012785 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93ac1e64-49f3-4f4e-a09a-0bf1e9982d88 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:39.013233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-93ac1e64-49f3-4f4e-a09a-0bf1e9982d88 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:39.041580 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-93ac1e64-49f3-4f4e-a09a-0bf1e9982d88 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042506 May 24 13:33:39.042130 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 955/1902] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:40.053291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ba902d4a-6170-4ff0-9a8e-fefc4966ce11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:40.054208 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ba902d4a-6170-4ff0-9a8e-fefc4966ce11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:40.061289 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba902d4a-6170-4ff0-9a8e-fefc4966ce11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:40.061733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba902d4a-6170-4ff0-9a8e-fefc4966ce11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:40.062514 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba902d4a-6170-4ff0-9a8e-fefc4966ce11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:40.062943 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba902d4a-6170-4ff0-9a8e-fefc4966ce11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:40.091901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ba902d4a-6170-4ff0-9a8e-fefc4966ce11 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042714 May 24 13:33:40.092446 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 948/1903] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:40 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:41.104034 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-96268555-d621-48ce-ba29-ff7b12c4c0a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:41.104968 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-96268555-d621-48ce-ba29-ff7b12c4c0a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:41.111523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-96268555-d621-48ce-ba29-ff7b12c4c0a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:41.111977 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-96268555-d621-48ce-ba29-ff7b12c4c0a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:41.112741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-96268555-d621-48ce-ba29-ff7b12c4c0a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:41.113179 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-96268555-d621-48ce-ba29-ff7b12c4c0a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:41.142347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-96268555-d621-48ce-ba29-ff7b12c4c0a2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042402 May 24 13:33:41.142903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 956/1904] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:33:42.153929 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-766dc55f-8f49-4a89-9416-d644f628e246 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:42.154918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-766dc55f-8f49-4a89-9416-d644f628e246 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:42.161397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-766dc55f-8f49-4a89-9416-d644f628e246 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:42.161850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-766dc55f-8f49-4a89-9416-d644f628e246 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:42.162643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-766dc55f-8f49-4a89-9416-d644f628e246 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:42.163082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-766dc55f-8f49-4a89-9416-d644f628e246 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:42.192070 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-766dc55f-8f49-4a89-9416-d644f628e246 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042139 May 24 13:33:42.192610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 949/1905] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:43.203727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6f706cb5-108e-434d-8f7a-8cf4de07109f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:43.204571 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6f706cb5-108e-434d-8f7a-8cf4de07109f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:43.211075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f706cb5-108e-434d-8f7a-8cf4de07109f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:43.211525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f706cb5-108e-434d-8f7a-8cf4de07109f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:43.212285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f706cb5-108e-434d-8f7a-8cf4de07109f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:43.212751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6f706cb5-108e-434d-8f7a-8cf4de07109f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:43.243902 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6f706cb5-108e-434d-8f7a-8cf4de07109f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044238 May 24 13:33:43.245148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 957/1906] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:44.257548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dc7c9849-795c-46f2-afa9-daae4731a825 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:44.258593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dc7c9849-795c-46f2-afa9-daae4731a825 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:44.266449 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc7c9849-795c-46f2-afa9-daae4731a825 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:44.266904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc7c9849-795c-46f2-afa9-daae4731a825 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:44.267662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc7c9849-795c-46f2-afa9-daae4731a825 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:44.268105 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc7c9849-795c-46f2-afa9-daae4731a825 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:44.297654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dc7c9849-795c-46f2-afa9-daae4731a825 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044963 May 24 13:33:44.298227 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 950/1907] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:45.309819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-87280607-46e7-4941-8a62-6fc7f7a6b373 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:45.310778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-87280607-46e7-4941-8a62-6fc7f7a6b373 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:45.317267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-87280607-46e7-4941-8a62-6fc7f7a6b373 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:45.317723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-87280607-46e7-4941-8a62-6fc7f7a6b373 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:45.318520 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-87280607-46e7-4941-8a62-6fc7f7a6b373 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:45.318964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-87280607-46e7-4941-8a62-6fc7f7a6b373 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:45.348372 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-87280607-46e7-4941-8a62-6fc7f7a6b373 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043071 May 24 13:33:45.348929 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 958/1908] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:46.359876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fcf48171-d97d-4be5-b3be-51067c2264a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:46.360798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fcf48171-d97d-4be5-b3be-51067c2264a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:46.367452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf48171-d97d-4be5-b3be-51067c2264a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:46.367903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf48171-d97d-4be5-b3be-51067c2264a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:46.368703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf48171-d97d-4be5-b3be-51067c2264a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:46.369171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf48171-d97d-4be5-b3be-51067c2264a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:46.398766 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fcf48171-d97d-4be5-b3be-51067c2264a6 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042776 May 24 13:33:46.399312 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 951/1909] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:47.410862 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f493231b-93e9-498d-908b-23dcb5e69448 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:47.411974 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f493231b-93e9-498d-908b-23dcb5e69448 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:47.419002 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f493231b-93e9-498d-908b-23dcb5e69448 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:47.419465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f493231b-93e9-498d-908b-23dcb5e69448 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:47.420237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f493231b-93e9-498d-908b-23dcb5e69448 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:47.420679 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f493231b-93e9-498d-908b-23dcb5e69448 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:47.451042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f493231b-93e9-498d-908b-23dcb5e69448 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044196 May 24 13:33:47.451598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 959/1910] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:48.463011 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-86be353a-8121-4e68-9690-3eeb27f70a4d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:48.463822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-86be353a-8121-4e68-9690-3eeb27f70a4d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:48.470983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86be353a-8121-4e68-9690-3eeb27f70a4d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:48.471406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86be353a-8121-4e68-9690-3eeb27f70a4d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:48.472175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86be353a-8121-4e68-9690-3eeb27f70a4d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:48.472884 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86be353a-8121-4e68-9690-3eeb27f70a4d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:48.504609 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-86be353a-8121-4e68-9690-3eeb27f70a4d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045535 May 24 13:33:48.505356 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 952/1911] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:49.517023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-79fff0ba-53d6-4ceb-9d01-03405094fdfa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:49.517945 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-79fff0ba-53d6-4ceb-9d01-03405094fdfa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:49.524438 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-79fff0ba-53d6-4ceb-9d01-03405094fdfa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:49.524885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-79fff0ba-53d6-4ceb-9d01-03405094fdfa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:49.525637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-79fff0ba-53d6-4ceb-9d01-03405094fdfa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:49.526071 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-79fff0ba-53d6-4ceb-9d01-03405094fdfa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:49.554147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-79fff0ba-53d6-4ceb-9d01-03405094fdfa tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041118 May 24 13:33:49.554710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 960/1912] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:50.566010 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a41750f-2aef-45f8-9522-a07232c06a1e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:50.566970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a41750f-2aef-45f8-9522-a07232c06a1e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:50.574048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a41750f-2aef-45f8-9522-a07232c06a1e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:50.574521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a41750f-2aef-45f8-9522-a07232c06a1e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:50.575283 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a41750f-2aef-45f8-9522-a07232c06a1e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:50.575720 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a41750f-2aef-45f8-9522-a07232c06a1e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:50.605667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a41750f-2aef-45f8-9522-a07232c06a1e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043483 May 24 13:33:50.606214 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 953/1913] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:51.616611 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-33436928-004e-4d56-b492-8c53a648a1e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:51.617448 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-33436928-004e-4d56-b492-8c53a648a1e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:51.624242 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33436928-004e-4d56-b492-8c53a648a1e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:51.624689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33436928-004e-4d56-b492-8c53a648a1e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:51.625459 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33436928-004e-4d56-b492-8c53a648a1e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:51.625892 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-33436928-004e-4d56-b492-8c53a648a1e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:51.655544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-33436928-004e-4d56-b492-8c53a648a1e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042972 May 24 13:33:51.656089 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 961/1914] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:52.667873 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-afeb30c7-0f33-48a1-88c7-fd22531c161f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:52.668728 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-afeb30c7-0f33-48a1-88c7-fd22531c161f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:52.675272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afeb30c7-0f33-48a1-88c7-fd22531c161f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:52.675718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afeb30c7-0f33-48a1-88c7-fd22531c161f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:52.676468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afeb30c7-0f33-48a1-88c7-fd22531c161f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:52.676900 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afeb30c7-0f33-48a1-88c7-fd22531c161f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:52.705255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-afeb30c7-0f33-48a1-88c7-fd22531c161f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042095 May 24 13:33:52.705811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 954/1915] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:53.716206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8d0d1f65-7f21-456c-a81c-7c88e9febd69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:53.717124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8d0d1f65-7f21-456c-a81c-7c88e9febd69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:53.723830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d0d1f65-7f21-456c-a81c-7c88e9febd69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:53.724281 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d0d1f65-7f21-456c-a81c-7c88e9febd69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:53.725037 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d0d1f65-7f21-456c-a81c-7c88e9febd69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:53.725474 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d0d1f65-7f21-456c-a81c-7c88e9febd69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:53.755949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8d0d1f65-7f21-456c-a81c-7c88e9febd69 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043727 May 24 13:33:53.756505 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 962/1916] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:54.338818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-14046d2e-208a-4515-b262-95621cdae51f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:54.339400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-14046d2e-208a-4515-b262-95621cdae51f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:54.345815 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14046d2e-208a-4515-b262-95621cdae51f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:54.346303 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14046d2e-208a-4515-b262-95621cdae51f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:54.347070 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14046d2e-208a-4515-b262-95621cdae51f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:54.347771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14046d2e-208a-4515-b262-95621cdae51f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:54.350077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:33:54.373678 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-14046d2e-208a-4515-b262-95621cdae51f tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3/ips" status: 200 len: 149 microversion: 2.1 time: 0.038688 May 24 13:33:54.374246 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 955/1917] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 13:33:54 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:54.767534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f48cd62f-8122-4a1e-9bde-ab5306b33ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:54.768485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f48cd62f-8122-4a1e-9bde-ab5306b33ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:54.774850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f48cd62f-8122-4a1e-9bde-ab5306b33ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:54.775835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f48cd62f-8122-4a1e-9bde-ab5306b33ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:54.776592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f48cd62f-8122-4a1e-9bde-ab5306b33ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:54.777027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f48cd62f-8122-4a1e-9bde-ab5306b33ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:54.805849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f48cd62f-8122-4a1e-9bde-ab5306b33ca9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042264 May 24 13:33:54.806414 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 963/1918] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:55.817403 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-da475527-4bf3-4838-9fd3-e4a247a390ea tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:55.818396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-da475527-4bf3-4838-9fd3-e4a247a390ea tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:55.825738 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da475527-4bf3-4838-9fd3-e4a247a390ea tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:55.826195 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da475527-4bf3-4838-9fd3-e4a247a390ea tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:55.827026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da475527-4bf3-4838-9fd3-e4a247a390ea tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:55.827465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da475527-4bf3-4838-9fd3-e4a247a390ea tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:55.857393 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-da475527-4bf3-4838-9fd3-e4a247a390ea tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043949 May 24 13:33:55.857941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 956/1919] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:56.869392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4d0fb67f-9407-4d46-b3b3-a63770aec1e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:56.870371 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4d0fb67f-9407-4d46-b3b3-a63770aec1e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:56.876743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4d0fb67f-9407-4d46-b3b3-a63770aec1e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:56.877190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4d0fb67f-9407-4d46-b3b3-a63770aec1e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:56.877943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4d0fb67f-9407-4d46-b3b3-a63770aec1e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:56.878405 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4d0fb67f-9407-4d46-b3b3-a63770aec1e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:56.881885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:33:56.906762 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4d0fb67f-9407-4d46-b3b3-a63770aec1e0 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041855 May 24 13:33:56.907301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 964/1920] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:57.918083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-301d4ce6-a77c-4aab-bfa0-601ad17261e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:57.919020 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-301d4ce6-a77c-4aab-bfa0-601ad17261e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:57.925093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-301d4ce6-a77c-4aab-bfa0-601ad17261e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:57.925534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-301d4ce6-a77c-4aab-bfa0-601ad17261e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:57.926292 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-301d4ce6-a77c-4aab-bfa0-601ad17261e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:57.926732 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-301d4ce6-a77c-4aab-bfa0-601ad17261e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:57.954926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-301d4ce6-a77c-4aab-bfa0-601ad17261e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041574 May 24 13:33:57.955467 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 957/1921] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:33:58.967430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2b6c9477-5967-4385-8491-695d06dab956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:33:58.968356 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2b6c9477-5967-4385-8491-695d06dab956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:33:58.974917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b6c9477-5967-4385-8491-695d06dab956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:58.975370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b6c9477-5967-4385-8491-695d06dab956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:58.977643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b6c9477-5967-4385-8491-695d06dab956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:33:58.977643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2b6c9477-5967-4385-8491-695d06dab956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:33:59.006018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2b6c9477-5967-4385-8491-695d06dab956 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043517 May 24 13:33:59.006512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 965/1922] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:33:58 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:00.017816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-11f87923-1a34-4c45-b78e-dffe9725d08e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:00.018786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-11f87923-1a34-4c45-b78e-dffe9725d08e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:00.025336 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11f87923-1a34-4c45-b78e-dffe9725d08e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:00.025781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11f87923-1a34-4c45-b78e-dffe9725d08e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:00.026570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11f87923-1a34-4c45-b78e-dffe9725d08e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:00.027001 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11f87923-1a34-4c45-b78e-dffe9725d08e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:00.059237 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-11f87923-1a34-4c45-b78e-dffe9725d08e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045353 May 24 13:34:00.059769 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 958/1923] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:34:01.071076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7a776c1c-b3c1-4ba0-8016-be85fd1db01a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:01.072603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7a776c1c-b3c1-4ba0-8016-be85fd1db01a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:01.079143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7a776c1c-b3c1-4ba0-8016-be85fd1db01a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:01.079598 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7a776c1c-b3c1-4ba0-8016-be85fd1db01a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:01.080362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7a776c1c-b3c1-4ba0-8016-be85fd1db01a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:01.080801 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7a776c1c-b3c1-4ba0-8016-be85fd1db01a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:01.109953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7a776c1c-b3c1-4ba0-8016-be85fd1db01a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042820 May 24 13:34:01.110525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 966/1924] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:01 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:02.120956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8873e94a-a613-4e7f-9b89-49d5c1d988ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:02.121872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8873e94a-a613-4e7f-9b89-49d5c1d988ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:02.128348 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8873e94a-a613-4e7f-9b89-49d5c1d988ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:02.128794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8873e94a-a613-4e7f-9b89-49d5c1d988ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:02.129552 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8873e94a-a613-4e7f-9b89-49d5c1d988ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:02.129983 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8873e94a-a613-4e7f-9b89-49d5c1d988ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:02.160167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8873e94a-a613-4e7f-9b89-49d5c1d988ad tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043247 May 24 13:34:02.160711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 959/1925] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:03.172219 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-66434145-6a12-4341-b070-719f2a4a05d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:03.173175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-66434145-6a12-4341-b070-719f2a4a05d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:03.179780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66434145-6a12-4341-b070-719f2a4a05d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:03.180209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66434145-6a12-4341-b070-719f2a4a05d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:03.180969 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66434145-6a12-4341-b070-719f2a4a05d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:03.181398 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-66434145-6a12-4341-b070-719f2a4a05d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:03.209718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-66434145-6a12-4341-b070-719f2a4a05d7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041428 May 24 13:34:03.210259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 967/1926] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:04.221078 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1f09f58a-eff7-4702-b317-5a3e3852e82b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:04.221995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1f09f58a-eff7-4702-b317-5a3e3852e82b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:04.224607 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:34:04.229752 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f09f58a-eff7-4702-b317-5a3e3852e82b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:04.230194 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f09f58a-eff7-4702-b317-5a3e3852e82b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:04.230980 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f09f58a-eff7-4702-b317-5a3e3852e82b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:04.231408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f09f58a-eff7-4702-b317-5a3e3852e82b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:04.260360 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1f09f58a-eff7-4702-b317-5a3e3852e82b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043233 May 24 13:34:04.260990 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 960/1927] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:05.272121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b23ae00d-e872-47f7-b87b-2fb42db17217 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:05.272986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b23ae00d-e872-47f7-b87b-2fb42db17217 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:05.275819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:34:05.281126 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b23ae00d-e872-47f7-b87b-2fb42db17217 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:05.281582 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b23ae00d-e872-47f7-b87b-2fb42db17217 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:05.282385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b23ae00d-e872-47f7-b87b-2fb42db17217 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:05.282833 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b23ae00d-e872-47f7-b87b-2fb42db17217 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:05.314733 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b23ae00d-e872-47f7-b87b-2fb42db17217 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046604 May 24 13:34:05.315334 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 968/1928] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:06.328717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-75c91a83-f854-4d1a-a10d-5eeefc81f949 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:06.331310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-75c91a83-f854-4d1a-a10d-5eeefc81f949 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:06.340596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75c91a83-f854-4d1a-a10d-5eeefc81f949 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:06.341212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75c91a83-f854-4d1a-a10d-5eeefc81f949 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:06.341982 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75c91a83-f854-4d1a-a10d-5eeefc81f949 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:06.342448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75c91a83-f854-4d1a-a10d-5eeefc81f949 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:06.373639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-75c91a83-f854-4d1a-a10d-5eeefc81f949 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050882 May 24 13:34:06.374123 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 961/1929] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:07.385583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-af7d3cf3-345d-4304-a281-cea7dacec7d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:07.386532 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-af7d3cf3-345d-4304-a281-cea7dacec7d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:07.393077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-af7d3cf3-345d-4304-a281-cea7dacec7d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:07.393534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-af7d3cf3-345d-4304-a281-cea7dacec7d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:07.394306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-af7d3cf3-345d-4304-a281-cea7dacec7d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:07.394759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-af7d3cf3-345d-4304-a281-cea7dacec7d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:07.425389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-af7d3cf3-345d-4304-a281-cea7dacec7d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044198 May 24 13:34:07.425916 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 969/1930] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:08.437495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1634d14e-a707-43e5-b2c3-ef6d394fd204 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:08.438458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1634d14e-a707-43e5-b2c3-ef6d394fd204 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:08.444944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1634d14e-a707-43e5-b2c3-ef6d394fd204 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:08.445395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1634d14e-a707-43e5-b2c3-ef6d394fd204 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:08.446155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1634d14e-a707-43e5-b2c3-ef6d394fd204 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:08.447274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1634d14e-a707-43e5-b2c3-ef6d394fd204 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:08.475917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1634d14e-a707-43e5-b2c3-ef6d394fd204 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042363 May 24 13:34:08.476395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 962/1931] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:09.487611 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f4fe288c-d269-4c1a-a99f-07bc4b5e2264 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:09.488541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f4fe288c-d269-4c1a-a99f-07bc4b5e2264 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:09.495066 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f4fe288c-d269-4c1a-a99f-07bc4b5e2264 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:09.495524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f4fe288c-d269-4c1a-a99f-07bc4b5e2264 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:09.496289 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f4fe288c-d269-4c1a-a99f-07bc4b5e2264 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:09.496733 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f4fe288c-d269-4c1a-a99f-07bc4b5e2264 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:09.526501 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f4fe288c-d269-4c1a-a99f-07bc4b5e2264 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042809 May 24 13:34:09.526985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 970/1932] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:10.537959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-673c9c74-384c-4542-8959-c872767e071b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:10.538926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-673c9c74-384c-4542-8959-c872767e071b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:10.545547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-673c9c74-384c-4542-8959-c872767e071b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:10.546002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-673c9c74-384c-4542-8959-c872767e071b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:10.546908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-673c9c74-384c-4542-8959-c872767e071b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:10.547350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-673c9c74-384c-4542-8959-c872767e071b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:10.577306 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-673c9c74-384c-4542-8959-c872767e071b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043254 May 24 13:34:10.577791 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 963/1933] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:11.589275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-09fc65c3-1487-402f-8f7a-ae36050186ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:11.590204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-09fc65c3-1487-402f-8f7a-ae36050186ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:11.596708 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-09fc65c3-1487-402f-8f7a-ae36050186ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:11.597417 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-09fc65c3-1487-402f-8f7a-ae36050186ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:11.598183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-09fc65c3-1487-402f-8f7a-ae36050186ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:11.598652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-09fc65c3-1487-402f-8f7a-ae36050186ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:11.628115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-09fc65c3-1487-402f-8f7a-ae36050186ef tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043231 May 24 13:34:11.628637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 971/1934] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:12.639526 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-631ed4d9-50f0-4680-86e9-5090e3e65325 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:12.640459 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-631ed4d9-50f0-4680-86e9-5090e3e65325 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:12.646947 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-631ed4d9-50f0-4680-86e9-5090e3e65325 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:12.647399 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-631ed4d9-50f0-4680-86e9-5090e3e65325 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:12.648159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-631ed4d9-50f0-4680-86e9-5090e3e65325 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:12.648594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-631ed4d9-50f0-4680-86e9-5090e3e65325 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:12.677324 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-631ed4d9-50f0-4680-86e9-5090e3e65325 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041760 May 24 13:34:12.677799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 964/1935] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:13.689466 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-693e797f-3e64-47e7-8ae6-05d311971c09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:13.690324 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-693e797f-3e64-47e7-8ae6-05d311971c09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:13.696927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-693e797f-3e64-47e7-8ae6-05d311971c09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:13.697375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-693e797f-3e64-47e7-8ae6-05d311971c09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:13.698133 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-693e797f-3e64-47e7-8ae6-05d311971c09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:13.698601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-693e797f-3e64-47e7-8ae6-05d311971c09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:13.728392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-693e797f-3e64-47e7-8ae6-05d311971c09 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042381 May 24 13:34:13.728950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 972/1936] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:14.740036 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1cc9fec2-5fa7-4aef-9596-922c4d249fac tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:14.740957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1cc9fec2-5fa7-4aef-9596-922c4d249fac tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:14.747476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cc9fec2-5fa7-4aef-9596-922c4d249fac tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:14.747934 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cc9fec2-5fa7-4aef-9596-922c4d249fac tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:14.748695 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cc9fec2-5fa7-4aef-9596-922c4d249fac tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:14.749132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cc9fec2-5fa7-4aef-9596-922c4d249fac tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:14.779176 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1cc9fec2-5fa7-4aef-9596-922c4d249fac tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043077 May 24 13:34:14.779660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 965/1937] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:15.789773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4cbbd6fe-6792-4bc9-88b8-c48a926f7ea8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:15.790646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4cbbd6fe-6792-4bc9-88b8-c48a926f7ea8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:15.797078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6fe-6792-4bc9-88b8-c48a926f7ea8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:15.797521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6fe-6792-4bc9-88b8-c48a926f7ea8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:15.798273 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6fe-6792-4bc9-88b8-c48a926f7ea8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:15.798727 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6fe-6792-4bc9-88b8-c48a926f7ea8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:15.828016 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4cbbd6fe-6792-4bc9-88b8-c48a926f7ea8 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042276 May 24 13:34:15.828548 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 973/1938] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:16.839799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bbbacc0e-0ad1-46c8-a4b3-097b964d9f0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:16.840710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bbbacc0e-0ad1-46c8-a4b3-097b964d9f0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:16.847412 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbbacc0e-0ad1-46c8-a4b3-097b964d9f0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:16.847859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbbacc0e-0ad1-46c8-a4b3-097b964d9f0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:16.848619 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbbacc0e-0ad1-46c8-a4b3-097b964d9f0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:16.849048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbbacc0e-0ad1-46c8-a4b3-097b964d9f0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:16.877931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bbbacc0e-0ad1-46c8-a4b3-097b964d9f0a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042494 May 24 13:34:16.878426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 966/1939] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:17.888985 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-11275ab1-f96f-40f0-8719-16ebd50c1ab9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:17.889946 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-11275ab1-f96f-40f0-8719-16ebd50c1ab9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:17.896456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11275ab1-f96f-40f0-8719-16ebd50c1ab9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:17.896909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11275ab1-f96f-40f0-8719-16ebd50c1ab9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:17.897681 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11275ab1-f96f-40f0-8719-16ebd50c1ab9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:17.898120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11275ab1-f96f-40f0-8719-16ebd50c1ab9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:17.941076 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-11275ab1-f96f-40f0-8719-16ebd50c1ab9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055861 May 24 13:34:17.941546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 974/1940] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:18.952719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7e428f93-fc6e-4eef-873c-0a9afb96fbb1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:18.953558 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7e428f93-fc6e-4eef-873c-0a9afb96fbb1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:18.959961 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e428f93-fc6e-4eef-873c-0a9afb96fbb1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:18.960408 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e428f93-fc6e-4eef-873c-0a9afb96fbb1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:18.961156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e428f93-fc6e-4eef-873c-0a9afb96fbb1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:18.961583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e428f93-fc6e-4eef-873c-0a9afb96fbb1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:18.991457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7e428f93-fc6e-4eef-873c-0a9afb96fbb1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042909 May 24 13:34:18.991982 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 967/1941] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:20.003135 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1cf34cbb-99af-4c53-8a36-fca5a808ed70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:20.003979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1cf34cbb-99af-4c53-8a36-fca5a808ed70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:20.010436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1cf34cbb-99af-4c53-8a36-fca5a808ed70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:20.010892 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1cf34cbb-99af-4c53-8a36-fca5a808ed70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:20.011652 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1cf34cbb-99af-4c53-8a36-fca5a808ed70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:20.012097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1cf34cbb-99af-4c53-8a36-fca5a808ed70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:20.041006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1cf34cbb-99af-4c53-8a36-fca5a808ed70 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041892 May 24 13:34:20.041545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 975/1942] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:21.052600 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d2bb5ae6-3d08-420d-b725-53755aa3304c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:21.053446 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d2bb5ae6-3d08-420d-b725-53755aa3304c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:21.060519 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2bb5ae6-3d08-420d-b725-53755aa3304c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:21.060975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2bb5ae6-3d08-420d-b725-53755aa3304c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:21.061774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2bb5ae6-3d08-420d-b725-53755aa3304c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:21.062221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2bb5ae6-3d08-420d-b725-53755aa3304c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:21.091178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d2bb5ae6-3d08-420d-b725-53755aa3304c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042639 May 24 13:34:21.091715 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 968/1943] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:21 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:22.103778 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2893a36a-c9be-4289-b7d6-cefe6e521cd7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:22.104630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2893a36a-c9be-4289-b7d6-cefe6e521cd7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:22.111184 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2893a36a-c9be-4289-b7d6-cefe6e521cd7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:22.111643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2893a36a-c9be-4289-b7d6-cefe6e521cd7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:22.112409 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2893a36a-c9be-4289-b7d6-cefe6e521cd7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:22.112850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2893a36a-c9be-4289-b7d6-cefe6e521cd7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:22.142040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2893a36a-c9be-4289-b7d6-cefe6e521cd7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043000 May 24 13:34:22.142642 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 976/1944] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:23.155126 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b6cc384d-2781-4e46-a9a2-045bbe36d2b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:23.155995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b6cc384d-2781-4e46-a9a2-045bbe36d2b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:23.162541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6cc384d-2781-4e46-a9a2-045bbe36d2b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:23.162991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6cc384d-2781-4e46-a9a2-045bbe36d2b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:23.163749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6cc384d-2781-4e46-a9a2-045bbe36d2b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:23.164188 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b6cc384d-2781-4e46-a9a2-045bbe36d2b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:23.192795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b6cc384d-2781-4e46-a9a2-045bbe36d2b5 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042255 May 24 13:34:23.193352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 969/1945] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:24.204967 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2c833e9f-9791-4337-9921-86e35acec678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:24.205809 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2c833e9f-9791-4337-9921-86e35acec678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:24.213040 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c833e9f-9791-4337-9921-86e35acec678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:24.213499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c833e9f-9791-4337-9921-86e35acec678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:24.214263 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c833e9f-9791-4337-9921-86e35acec678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:24.214741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2c833e9f-9791-4337-9921-86e35acec678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:24.244707 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2c833e9f-9791-4337-9921-86e35acec678 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043766 May 24 13:34:24.245263 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 977/1946] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:25.256440 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-915d7c99-946e-4977-ba12-b50540caee49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:25.257278 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-915d7c99-946e-4977-ba12-b50540caee49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:25.263882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d7c99-946e-4977-ba12-b50540caee49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:25.264330 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d7c99-946e-4977-ba12-b50540caee49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:25.265085 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d7c99-946e-4977-ba12-b50540caee49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:25.265518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d7c99-946e-4977-ba12-b50540caee49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:25.269041 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=88 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:34:25.294457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-915d7c99-946e-4977-ba12-b50540caee49 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042202 May 24 13:34:25.294991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 970/1947] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:34:26.306219 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-046a1200-a958-4f09-8416-93fb0222a3fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:26.307264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-046a1200-a958-4f09-8416-93fb0222a3fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:26.313702 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-046a1200-a958-4f09-8416-93fb0222a3fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:26.314153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-046a1200-a958-4f09-8416-93fb0222a3fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:26.314951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-046a1200-a958-4f09-8416-93fb0222a3fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:26.315392 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-046a1200-a958-4f09-8416-93fb0222a3fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:26.344568 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-046a1200-a958-4f09-8416-93fb0222a3fc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042756 May 24 13:34:26.345121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 978/1948] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:27.356984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d6f9c999-f891-4588-b5f2-9dc0bc47c8b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:27.357833 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d6f9c999-f891-4588-b5f2-9dc0bc47c8b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:27.363830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6f9c999-f891-4588-b5f2-9dc0bc47c8b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:27.364274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6f9c999-f891-4588-b5f2-9dc0bc47c8b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:27.365024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6f9c999-f891-4588-b5f2-9dc0bc47c8b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:27.365453 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6f9c999-f891-4588-b5f2-9dc0bc47c8b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:27.394564 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d6f9c999-f891-4588-b5f2-9dc0bc47c8b1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042254 May 24 13:34:27.395111 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 971/1949] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:27 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:28.406209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d84a861a-2dc3-4a9e-89d3-6011fc42522b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:28.407168 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d84a861a-2dc3-4a9e-89d3-6011fc42522b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:28.413426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d84a861a-2dc3-4a9e-89d3-6011fc42522b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:28.413885 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d84a861a-2dc3-4a9e-89d3-6011fc42522b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:28.414703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d84a861a-2dc3-4a9e-89d3-6011fc42522b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:28.415740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d84a861a-2dc3-4a9e-89d3-6011fc42522b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:28.418703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:34:28.446698 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d84a861a-2dc3-4a9e-89d3-6011fc42522b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044443 May 24 13:34:28.447301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 979/1950] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:29.457423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-31c84d0c-be7b-4dd9-afde-bdda06133b22 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:29.458379 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-31c84d0c-be7b-4dd9-afde-bdda06133b22 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:29.465335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31c84d0c-be7b-4dd9-afde-bdda06133b22 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:29.465788 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31c84d0c-be7b-4dd9-afde-bdda06133b22 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:29.466586 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31c84d0c-be7b-4dd9-afde-bdda06133b22 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:29.467127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31c84d0c-be7b-4dd9-afde-bdda06133b22 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:29.499721 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-31c84d0c-be7b-4dd9-afde-bdda06133b22 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046250 May 24 13:34:29.500271 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 972/1951] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:30.512186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d03bbe58-9f85-44c0-96b6-9b18911766c7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:30.512186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d03bbe58-9f85-44c0-96b6-9b18911766c7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:30.525107 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d03bbe58-9f85-44c0-96b6-9b18911766c7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:30.525562 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d03bbe58-9f85-44c0-96b6-9b18911766c7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:30.526373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d03bbe58-9f85-44c0-96b6-9b18911766c7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:30.526812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d03bbe58-9f85-44c0-96b6-9b18911766c7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:30.560255 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d03bbe58-9f85-44c0-96b6-9b18911766c7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052881 May 24 13:34:30.560808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 980/1952] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:30 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:31.570896 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7896715e-3848-49ef-84a1-2955b04c6340 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:31.572441 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7896715e-3848-49ef-84a1-2955b04c6340 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:31.578918 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7896715e-3848-49ef-84a1-2955b04c6340 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:31.579365 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7896715e-3848-49ef-84a1-2955b04c6340 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:31.580118 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7896715e-3848-49ef-84a1-2955b04c6340 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:31.580548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7896715e-3848-49ef-84a1-2955b04c6340 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:31.609292 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7896715e-3848-49ef-84a1-2955b04c6340 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042312 May 24 13:34:31.609844 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 973/1953] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:31 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:32.620850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a3a8861d-31d6-49c5-9770-0a1dadd97fd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:32.621771 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a3a8861d-31d6-49c5-9770-0a1dadd97fd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:32.628401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a3a8861d-31d6-49c5-9770-0a1dadd97fd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:32.628852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a3a8861d-31d6-49c5-9770-0a1dadd97fd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:32.629612 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a3a8861d-31d6-49c5-9770-0a1dadd97fd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:32.630050 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a3a8861d-31d6-49c5-9770-0a1dadd97fd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:32.660182 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a3a8861d-31d6-49c5-9770-0a1dadd97fd1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043196 May 24 13:34:32.660664 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 981/1954] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:33.672077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-39928dae-a7c2-45b9-8807-c9670add662d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:33.672962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-39928dae-a7c2-45b9-8807-c9670add662d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:33.679363 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39928dae-a7c2-45b9-8807-c9670add662d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:33.679807 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39928dae-a7c2-45b9-8807-c9670add662d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:33.680557 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39928dae-a7c2-45b9-8807-c9670add662d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:33.680989 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39928dae-a7c2-45b9-8807-c9670add662d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:33.709799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-39928dae-a7c2-45b9-8807-c9670add662d tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041751 May 24 13:34:33.710355 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 974/1955] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:33 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:34.720886 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3e3453ff-355b-4aec-8732-284f1f661d27 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:34.722073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3e3453ff-355b-4aec-8732-284f1f661d27 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:34.728754 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e3453ff-355b-4aec-8732-284f1f661d27 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:34.729218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e3453ff-355b-4aec-8732-284f1f661d27 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:34.729979 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e3453ff-355b-4aec-8732-284f1f661d27 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:34.730458 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3e3453ff-355b-4aec-8732-284f1f661d27 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:34.760061 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3e3453ff-355b-4aec-8732-284f1f661d27 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042466 May 24 13:34:34.760650 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 982/1956] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:34 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:35.771326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7a52a8ea-c97f-40eb-b438-4154a81a8b9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:35.772284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7a52a8ea-c97f-40eb-b438-4154a81a8b9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:35.774687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:34:35.781405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a52a8ea-c97f-40eb-b438-4154a81a8b9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:35.781860 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a52a8ea-c97f-40eb-b438-4154a81a8b9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:35.782667 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a52a8ea-c97f-40eb-b438-4154a81a8b9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:35.783110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7a52a8ea-c97f-40eb-b438-4154a81a8b9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:35.811801 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7a52a8ea-c97f-40eb-b438-4154a81a8b9c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044383 May 24 13:34:35.812353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 975/1957] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:35 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:36.823275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-9b0d80f7-9e35-4e38-bb0b-2fe210e545d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:36.824207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-9b0d80f7-9e35-4e38-bb0b-2fe210e545d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:36.826509 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:34:36.832003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b0d80f7-9e35-4e38-bb0b-2fe210e545d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:36.832454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b0d80f7-9e35-4e38-bb0b-2fe210e545d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:36.833244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b0d80f7-9e35-4e38-bb0b-2fe210e545d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:36.833800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-9b0d80f7-9e35-4e38-bb0b-2fe210e545d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:36.866426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-9b0d80f7-9e35-4e38-bb0b-2fe210e545d9 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047037 May 24 13:34:36.866983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 983/1958] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:36 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:37.876985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-44112b6a-e601-4daa-acdc-1a5794440274 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:37.877902 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-44112b6a-e601-4daa-acdc-1a5794440274 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:37.884865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44112b6a-e601-4daa-acdc-1a5794440274 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:37.885307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44112b6a-e601-4daa-acdc-1a5794440274 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:37.886053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44112b6a-e601-4daa-acdc-1a5794440274 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:37.886515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44112b6a-e601-4daa-acdc-1a5794440274 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:37.915555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-44112b6a-e601-4daa-acdc-1a5794440274 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042521 May 24 13:34:37.916094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 976/1959] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:37 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:38.930304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b447af12-8989-4f77-b561-7f77a59820e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:38.931889 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b447af12-8989-4f77-b561-7f77a59820e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:38.938603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b447af12-8989-4f77-b561-7f77a59820e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:38.939052 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b447af12-8989-4f77-b561-7f77a59820e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:38.939809 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b447af12-8989-4f77-b561-7f77a59820e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:38.940244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b447af12-8989-4f77-b561-7f77a59820e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:38.969601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b447af12-8989-4f77-b561-7f77a59820e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046157 May 24 13:34:38.970142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 984/1960] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:38 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:39.981998 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-705f9817-fe5d-425b-8ef1-3e0338d0bb62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:39.983039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-705f9817-fe5d-425b-8ef1-3e0338d0bb62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:39.989392 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f9817-fe5d-425b-8ef1-3e0338d0bb62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:39.989840 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f9817-fe5d-425b-8ef1-3e0338d0bb62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:39.990625 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f9817-fe5d-425b-8ef1-3e0338d0bb62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:39.991061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f9817-fe5d-425b-8ef1-3e0338d0bb62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:40.019856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-705f9817-fe5d-425b-8ef1-3e0338d0bb62 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042471 May 24 13:34:40.020401 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 977/1961] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:39 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:41.031209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c48ddd90-202b-421c-ac35-e37d9723f48c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:41.032143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-c48ddd90-202b-421c-ac35-e37d9723f48c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:41.038618 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c48ddd90-202b-421c-ac35-e37d9723f48c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:41.039083 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c48ddd90-202b-421c-ac35-e37d9723f48c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:41.039855 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c48ddd90-202b-421c-ac35-e37d9723f48c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:41.040843 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-c48ddd90-202b-421c-ac35-e37d9723f48c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:41.069954 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c48ddd90-202b-421c-ac35-e37d9723f48c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042669 May 24 13:34:41.070536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 985/1962] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:41 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:42.081315 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ea113fc4-989a-4865-8fe7-79880ada7b5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:42.082263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ea113fc4-989a-4865-8fe7-79880ada7b5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:42.088878 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea113fc4-989a-4865-8fe7-79880ada7b5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:42.089324 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea113fc4-989a-4865-8fe7-79880ada7b5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:42.090075 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea113fc4-989a-4865-8fe7-79880ada7b5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:42.090535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea113fc4-989a-4865-8fe7-79880ada7b5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:42.120053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ea113fc4-989a-4865-8fe7-79880ada7b5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042629 May 24 13:34:42.120617 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 978/1963] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:42 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:43.131704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3df49a21-eca2-4880-a2c3-1197a6ea1d76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:43.132629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3df49a21-eca2-4880-a2c3-1197a6ea1d76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:43.139704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3df49a21-eca2-4880-a2c3-1197a6ea1d76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:43.140149 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3df49a21-eca2-4880-a2c3-1197a6ea1d76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:43.140900 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3df49a21-eca2-4880-a2c3-1197a6ea1d76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:43.141332 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3df49a21-eca2-4880-a2c3-1197a6ea1d76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:43.175441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3df49a21-eca2-4880-a2c3-1197a6ea1d76 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047633 May 24 13:34:43.176010 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 986/1964] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:43 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:44.187537 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-807dcf07-0f87-412a-9e15-c852aae182fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:44.188495 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-807dcf07-0f87-412a-9e15-c852aae182fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:44.194986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-807dcf07-0f87-412a-9e15-c852aae182fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:44.195438 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-807dcf07-0f87-412a-9e15-c852aae182fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:44.196197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-807dcf07-0f87-412a-9e15-c852aae182fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:44.196633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-807dcf07-0f87-412a-9e15-c852aae182fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:44.227349 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-807dcf07-0f87-412a-9e15-c852aae182fb tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043699 May 24 13:34:44.228556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 979/1965] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:44 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:45.240442 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5fe7164d-8722-4d2b-ae71-53a9fec7f970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:45.241391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5fe7164d-8722-4d2b-ae71-53a9fec7f970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:45.248285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5fe7164d-8722-4d2b-ae71-53a9fec7f970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:45.248737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5fe7164d-8722-4d2b-ae71-53a9fec7f970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:45.249515 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5fe7164d-8722-4d2b-ae71-53a9fec7f970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:45.249955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5fe7164d-8722-4d2b-ae71-53a9fec7f970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:45.280960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5fe7164d-8722-4d2b-ae71-53a9fec7f970 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044521 May 24 13:34:45.281515 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 987/1966] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:45 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:46.292627 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e2a74e79-cdf8-4a49-a424-f8ef7ecf943a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:46.293476 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e2a74e79-cdf8-4a49-a424-f8ef7ecf943a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:46.302696 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2a74e79-cdf8-4a49-a424-f8ef7ecf943a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:46.303148 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2a74e79-cdf8-4a49-a424-f8ef7ecf943a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:46.303907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2a74e79-cdf8-4a49-a424-f8ef7ecf943a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:46.304341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2a74e79-cdf8-4a49-a424-f8ef7ecf943a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:46.333722 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e2a74e79-cdf8-4a49-a424-f8ef7ecf943a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045503 May 24 13:34:46.334278 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 980/1967] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:46 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:47.345763 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f10eb6ad-31bd-47ce-942e-a18ee90f59ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:47.346964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f10eb6ad-31bd-47ce-942e-a18ee90f59ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:47.354024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f10eb6ad-31bd-47ce-942e-a18ee90f59ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:47.354506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f10eb6ad-31bd-47ce-942e-a18ee90f59ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:47.355258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f10eb6ad-31bd-47ce-942e-a18ee90f59ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:47.355693 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f10eb6ad-31bd-47ce-942e-a18ee90f59ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:47.383935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f10eb6ad-31bd-47ce-942e-a18ee90f59ce tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042115 May 24 13:34:47.384485 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 988/1968] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:47 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:48.395649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6731db39-4144-42cd-8ab9-dd3b18310d1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:48.396493 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6731db39-4144-42cd-8ab9-dd3b18310d1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:48.403077 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6731db39-4144-42cd-8ab9-dd3b18310d1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:48.403518 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6731db39-4144-42cd-8ab9-dd3b18310d1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:48.404274 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6731db39-4144-42cd-8ab9-dd3b18310d1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:48.404710 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6731db39-4144-42cd-8ab9-dd3b18310d1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:48.434692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6731db39-4144-42cd-8ab9-dd3b18310d1a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043021 May 24 13:34:48.435234 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 981/1969] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:48 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:49.446371 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4615e3bc-8e56-4450-9649-539b3e327e0c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:49.447301 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4615e3bc-8e56-4450-9649-539b3e327e0c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:49.453667 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4615e3bc-8e56-4450-9649-539b3e327e0c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:49.454115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4615e3bc-8e56-4450-9649-539b3e327e0c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:49.454908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4615e3bc-8e56-4450-9649-539b3e327e0c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:49.455346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4615e3bc-8e56-4450-9649-539b3e327e0c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:49.484875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4615e3bc-8e56-4450-9649-539b3e327e0c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042451 May 24 13:34:49.485415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 989/1970] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:49 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:50.497096 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-83e1a66c-eed7-4e77-8c46-acc1398a8127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:50.498022 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-83e1a66c-eed7-4e77-8c46-acc1398a8127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:50.504561 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83e1a66c-eed7-4e77-8c46-acc1398a8127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:50.505012 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83e1a66c-eed7-4e77-8c46-acc1398a8127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:50.505768 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83e1a66c-eed7-4e77-8c46-acc1398a8127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:50.506200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83e1a66c-eed7-4e77-8c46-acc1398a8127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:50.535009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-83e1a66c-eed7-4e77-8c46-acc1398a8127 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042413 May 24 13:34:50.535545 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 982/1971] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:50 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:51.547015 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e88fe679-dc82-4d84-bd7b-f54a2a267980 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:51.547940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e88fe679-dc82-4d84-bd7b-f54a2a267980 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:51.554449 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e88fe679-dc82-4d84-bd7b-f54a2a267980 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:51.554901 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e88fe679-dc82-4d84-bd7b-f54a2a267980 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:51.556296 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e88fe679-dc82-4d84-bd7b-f54a2a267980 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:51.556743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e88fe679-dc82-4d84-bd7b-f54a2a267980 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:51.585063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e88fe679-dc82-4d84-bd7b-f54a2a267980 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041990 May 24 13:34:51.585604 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 990/1972] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:51 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:52.597302 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ecb5e9f2-2ec9-4322-8c4d-4cee04da8145 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:52.598253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ecb5e9f2-2ec9-4322-8c4d-4cee04da8145 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:52.605431 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ecb5e9f2-2ec9-4322-8c4d-4cee04da8145 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:52.605875 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ecb5e9f2-2ec9-4322-8c4d-4cee04da8145 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:52.606674 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ecb5e9f2-2ec9-4322-8c4d-4cee04da8145 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:52.607110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ecb5e9f2-2ec9-4322-8c4d-4cee04da8145 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:52.636939 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ecb5e9f2-2ec9-4322-8c4d-4cee04da8145 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044350 May 24 13:34:52.637496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 983/1973] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:52 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:53.648748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7eeb787a-ddaa-4e6e-b590-b85da4940b58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:53.649597 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7eeb787a-ddaa-4e6e-b590-b85da4940b58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:53.656831 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7eeb787a-ddaa-4e6e-b590-b85da4940b58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:53.657286 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7eeb787a-ddaa-4e6e-b590-b85da4940b58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:53.658057 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7eeb787a-ddaa-4e6e-b590-b85da4940b58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:53.658538 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7eeb787a-ddaa-4e6e-b590-b85da4940b58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:53.687999 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7eeb787a-ddaa-4e6e-b590-b85da4940b58 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043370 May 24 13:34:53.688555 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 991/1974] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:53 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:54.699763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b31e5b98-48c7-40a1-a7ef-3dafa534e10c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:54.700595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b31e5b98-48c7-40a1-a7ef-3dafa534e10c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:54.707083 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b31e5b98-48c7-40a1-a7ef-3dafa534e10c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:54.707528 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b31e5b98-48c7-40a1-a7ef-3dafa534e10c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:54.708276 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b31e5b98-48c7-40a1-a7ef-3dafa534e10c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:54.708704 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b31e5b98-48c7-40a1-a7ef-3dafa534e10c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:54.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b31e5b98-48c7-40a1-a7ef-3dafa534e10c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042696 May 24 13:34:54.738941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 984/1975] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:54 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:55.750230 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-91098b62-7d26-42e4-a1a1-f3c6b031c554 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:55.751187 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-91098b62-7d26-42e4-a1a1-f3c6b031c554 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:55.757496 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-91098b62-7d26-42e4-a1a1-f3c6b031c554 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:55.757948 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-91098b62-7d26-42e4-a1a1-f3c6b031c554 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:55.758759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-91098b62-7d26-42e4-a1a1-f3c6b031c554 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:55.759846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-91098b62-7d26-42e4-a1a1-f3c6b031c554 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:55.788690 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-91098b62-7d26-42e4-a1a1-f3c6b031c554 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042434 May 24 13:34:55.789238 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 992/1976] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:55 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:56.800955 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-568b628f-11e7-41b1-b6f7-43ef2f97b377 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:56.801818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-568b628f-11e7-41b1-b6f7-43ef2f97b377 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:56.808525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-568b628f-11e7-41b1-b6f7-43ef2f97b377 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:56.808981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-568b628f-11e7-41b1-b6f7-43ef2f97b377 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:56.809750 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-568b628f-11e7-41b1-b6f7-43ef2f97b377 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:56.810203 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-568b628f-11e7-41b1-b6f7-43ef2f97b377 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:56.812553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:34:56.840225 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-568b628f-11e7-41b1-b6f7-43ef2f97b377 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043454 May 24 13:34:56.840785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 985/1977] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:56 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:57.851257 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0a43bfae-a9d3-40f3-a0c5-ae1cdd3161e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:57.852183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0a43bfae-a9d3-40f3-a0c5-ae1cdd3161e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:57.859014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0a43bfae-a9d3-40f3-a0c5-ae1cdd3161e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:57.859470 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0a43bfae-a9d3-40f3-a0c5-ae1cdd3161e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:57.860231 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0a43bfae-a9d3-40f3-a0c5-ae1cdd3161e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:57.860670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0a43bfae-a9d3-40f3-a0c5-ae1cdd3161e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:57.889157 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0a43bfae-a9d3-40f3-a0c5-ae1cdd3161e3 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041857 May 24 13:34:57.889704 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 993/1978] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:57 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:58.900685 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-30ffdb5c-5d50-405f-bfad-9f3885fea450 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:58.901615 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-30ffdb5c-5d50-405f-bfad-9f3885fea450 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:58.908196 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30ffdb5c-5d50-405f-bfad-9f3885fea450 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:58.908649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30ffdb5c-5d50-405f-bfad-9f3885fea450 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:58.909415 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30ffdb5c-5d50-405f-bfad-9f3885fea450 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:58.909852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30ffdb5c-5d50-405f-bfad-9f3885fea450 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:58.939512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-30ffdb5c-5d50-405f-bfad-9f3885fea450 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042923 May 24 13:34:58.940048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 986/1979] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:58 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:34:59.950853 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-31dd03a3-d2d2-47bd-a55d-f4ba36bef73c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:34:59.951777 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-31dd03a3-d2d2-47bd-a55d-f4ba36bef73c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:34:59.958161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-31dd03a3-d2d2-47bd-a55d-f4ba36bef73c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:59.958634 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-31dd03a3-d2d2-47bd-a55d-f4ba36bef73c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:59.959388 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-31dd03a3-d2d2-47bd-a55d-f4ba36bef73c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:34:59.959832 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-31dd03a3-d2d2-47bd-a55d-f4ba36bef73c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:34:59.962659 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=90 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:34:59.990635 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-31dd03a3-d2d2-47bd-a55d-f4ba36bef73c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043779 May 24 13:34:59.991186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 994/1980] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:34:59 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:00.716549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 24 13:35:00.716549 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:35:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:35:01.002052 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-617a49c6-a15c-4337-8b99-b035a9343151 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:01.002912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-617a49c6-a15c-4337-8b99-b035a9343151 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:01.010024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-617a49c6-a15c-4337-8b99-b035a9343151 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:01.010502 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-617a49c6-a15c-4337-8b99-b035a9343151 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:01.011254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-617a49c6-a15c-4337-8b99-b035a9343151 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:01.011682 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-617a49c6-a15c-4337-8b99-b035a9343151 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:01.039965 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-617a49c6-a15c-4337-8b99-b035a9343151 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041879 May 24 13:35:01.041133 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 987/1981] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:00 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:02.052146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3de904e1-683c-44c7-b410-98ed9e1a6060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:02.053065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3de904e1-683c-44c7-b410-98ed9e1a6060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:02.059610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3de904e1-683c-44c7-b410-98ed9e1a6060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:02.060072 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3de904e1-683c-44c7-b410-98ed9e1a6060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:02.060949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3de904e1-683c-44c7-b410-98ed9e1a6060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:02.061259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3de904e1-683c-44c7-b410-98ed9e1a6060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:02.091481 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3de904e1-683c-44c7-b410-98ed9e1a6060 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043271 May 24 13:35:02.091966 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 995/1982] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:02 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:03.103561 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-35be0762-b583-4c99-b5ac-8b31e3ee4614 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:03.104521 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-35be0762-b583-4c99-b5ac-8b31e3ee4614 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:03.111130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-35be0762-b583-4c99-b5ac-8b31e3ee4614 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:03.111583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-35be0762-b583-4c99-b5ac-8b31e3ee4614 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:03.112396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-35be0762-b583-4c99-b5ac-8b31e3ee4614 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:03.112789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-35be0762-b583-4c99-b5ac-8b31e3ee4614 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:03.141793 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-35be0762-b583-4c99-b5ac-8b31e3ee4614 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042882 May 24 13:35:03.142352 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 988/1983] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:03 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:04.153195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5320f886-2b85-44b9-b159-aeded786f860 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:04.154119 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5320f886-2b85-44b9-b159-aeded786f860 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:04.160583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5320f886-2b85-44b9-b159-aeded786f860 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:04.161028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5320f886-2b85-44b9-b159-aeded786f860 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:04.161783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5320f886-2b85-44b9-b159-aeded786f860 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:04.162218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5320f886-2b85-44b9-b159-aeded786f860 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:04.192699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5320f886-2b85-44b9-b159-aeded786f860 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043429 May 24 13:35:04.193188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 996/1984] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:04 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:05.203492 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2c963abd-863f-4580-bc27-a628af50ba5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:05.204414 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2c963abd-863f-4580-bc27-a628af50ba5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:05.210831 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c963abd-863f-4580-bc27-a628af50ba5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:05.211280 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c963abd-863f-4580-bc27-a628af50ba5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:05.212063 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c963abd-863f-4580-bc27-a628af50ba5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:05.212492 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c963abd-863f-4580-bc27-a628af50ba5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:05.242327 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2c963abd-863f-4580-bc27-a628af50ba5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042628 May 24 13:35:05.242789 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 989/1985] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:05 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:06.254371 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ccaee22c-0f2e-49f6-8fe5-937fe1f5d86f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:06.255297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ccaee22c-0f2e-49f6-8fe5-937fe1f5d86f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:06.261892 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ccaee22c-0f2e-49f6-8fe5-937fe1f5d86f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:06.262375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ccaee22c-0f2e-49f6-8fe5-937fe1f5d86f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:06.263143 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ccaee22c-0f2e-49f6-8fe5-937fe1f5d86f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:06.263579 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ccaee22c-0f2e-49f6-8fe5-937fe1f5d86f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:06.293147 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ccaee22c-0f2e-49f6-8fe5-937fe1f5d86f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042722 May 24 13:35:06.293603 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 997/1986] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:06 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:07.305037 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-be72d3a1-5a16-4c6e-a28e-02fb4a50d691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:07.306598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-be72d3a1-5a16-4c6e-a28e-02fb4a50d691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:07.308925 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:35:07.314680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be72d3a1-5a16-4c6e-a28e-02fb4a50d691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:07.315132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be72d3a1-5a16-4c6e-a28e-02fb4a50d691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:07.315904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be72d3a1-5a16-4c6e-a28e-02fb4a50d691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:07.316341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be72d3a1-5a16-4c6e-a28e-02fb4a50d691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:07.345048 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-be72d3a1-5a16-4c6e-a28e-02fb4a50d691 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043952 May 24 13:35:07.345529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 990/1987] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:07 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:08.356541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8a7fa2b5-019b-429c-af05-0473d4c9e79e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:08.357471 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8a7fa2b5-019b-429c-af05-0473d4c9e79e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:08.359783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:35:08.365419 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a7fa2b5-019b-429c-af05-0473d4c9e79e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:08.365872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a7fa2b5-019b-429c-af05-0473d4c9e79e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:08.366661 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a7fa2b5-019b-429c-af05-0473d4c9e79e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:08.367104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a7fa2b5-019b-429c-af05-0473d4c9e79e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:08.398557 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8a7fa2b5-019b-429c-af05-0473d4c9e79e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046460 May 24 13:35:08.399059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 998/1988] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:08 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:09.409955 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-054af575-3fcb-434a-983f-0cf61ce360e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:09.410911 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-054af575-3fcb-434a-983f-0cf61ce360e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:09.417456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-054af575-3fcb-434a-983f-0cf61ce360e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:09.417906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-054af575-3fcb-434a-983f-0cf61ce360e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:09.418709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-054af575-3fcb-434a-983f-0cf61ce360e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:09.419142 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-054af575-3fcb-434a-983f-0cf61ce360e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:09.449025 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-054af575-3fcb-434a-983f-0cf61ce360e4 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042931 May 24 13:35:09.449498 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 991/1989] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:09 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:10.460433 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1338143a-bfdf-4f2a-ac9d-21532ef988ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:10.461367 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1338143a-bfdf-4f2a-ac9d-21532ef988ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:10.468456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1338143a-bfdf-4f2a-ac9d-21532ef988ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:10.468909 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1338143a-bfdf-4f2a-ac9d-21532ef988ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:10.469730 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1338143a-bfdf-4f2a-ac9d-21532ef988ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:10.470121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1338143a-bfdf-4f2a-ac9d-21532ef988ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:10.499728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1338143a-bfdf-4f2a-ac9d-21532ef988ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043230 May 24 13:35:10.500306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 999/1990] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:10 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:11.512003 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-644df0c4-01e1-4b96-9cec-d1371cedc92c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:11.512922 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-644df0c4-01e1-4b96-9cec-d1371cedc92c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:11.519213 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-644df0c4-01e1-4b96-9cec-d1371cedc92c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:11.519605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-644df0c4-01e1-4b96-9cec-d1371cedc92c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:11.520353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-644df0c4-01e1-4b96-9cec-d1371cedc92c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:11.520786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-644df0c4-01e1-4b96-9cec-d1371cedc92c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:11.548822 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-644df0c4-01e1-4b96-9cec-d1371cedc92c tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041423 May 24 13:35:11.549353 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 992/1991] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:11 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:12.560797 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d97a8923-0a49-42f9-9d8c-2f28b3fef45f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:12.561728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d97a8923-0a49-42f9-9d8c-2f28b3fef45f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:12.568268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d97a8923-0a49-42f9-9d8c-2f28b3fef45f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:12.568660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d97a8923-0a49-42f9-9d8c-2f28b3fef45f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:12.569416 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d97a8923-0a49-42f9-9d8c-2f28b3fef45f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:12.569853 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d97a8923-0a49-42f9-9d8c-2f28b3fef45f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:12.598550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d97a8923-0a49-42f9-9d8c-2f28b3fef45f tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041611 May 24 13:35:12.599090 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1000/1992] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:12 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:13.610613 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e1c56b0d-400a-487c-8a10-cc34dc562d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:13.611543 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e1c56b0d-400a-487c-8a10-cc34dc562d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:13.618714 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1c56b0d-400a-487c-8a10-cc34dc562d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:13.619104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1c56b0d-400a-487c-8a10-cc34dc562d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:13.619862 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1c56b0d-400a-487c-8a10-cc34dc562d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:13.620295 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1c56b0d-400a-487c-8a10-cc34dc562d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:13.649002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e1c56b0d-400a-487c-8a10-cc34dc562d2e tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042394 May 24 13:35:13.649538 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 993/1993] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:13 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:14.660524 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8a987412-0917-4bea-b049-2f06cde53dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:14.661448 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8a987412-0917-4bea-b049-2f06cde53dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:14.667930 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a987412-0917-4bea-b049-2f06cde53dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:14.668380 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a987412-0917-4bea-b049-2f06cde53dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:14.669153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a987412-0917-4bea-b049-2f06cde53dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:14.669591 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8a987412-0917-4bea-b049-2f06cde53dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:14.698767 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8a987412-0917-4bea-b049-2f06cde53dbd tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042214 May 24 13:35:14.699309 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1001/1994] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:14 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:15.710462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-254b011f-12fb-4dfc-9753-2bf4d4de51e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:15.711298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-254b011f-12fb-4dfc-9753-2bf4d4de51e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:15.718228 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-254b011f-12fb-4dfc-9753-2bf4d4de51e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:15.718707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-254b011f-12fb-4dfc-9753-2bf4d4de51e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:15.719470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-254b011f-12fb-4dfc-9753-2bf4d4de51e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:15.719901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-254b011f-12fb-4dfc-9753-2bf4d4de51e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:15.748903 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-254b011f-12fb-4dfc-9753-2bf4d4de51e7 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042560 May 24 13:35:15.749432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 994/1995] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:15 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:16.759672 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-59e11d66-f342-4fa3-869f-1c0b8eb923bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:16.760528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-59e11d66-f342-4fa3-869f-1c0b8eb923bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:16.767123 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59e11d66-f342-4fa3-869f-1c0b8eb923bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:16.767577 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59e11d66-f342-4fa3-869f-1c0b8eb923bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:16.768336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59e11d66-f342-4fa3-869f-1c0b8eb923bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:16.768773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-59e11d66-f342-4fa3-869f-1c0b8eb923bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:16.806154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-59e11d66-f342-4fa3-869f-1c0b8eb923bc tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050412 May 24 13:35:16.806758 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1002/1996] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:16 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:17.817470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-08472954-97ba-48d5-8608-cb91e73f3153 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:17.818428 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-08472954-97ba-48d5-8608-cb91e73f3153 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:17.824942 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08472954-97ba-48d5-8608-cb91e73f3153 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:17.825397 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08472954-97ba-48d5-8608-cb91e73f3153 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:17.826167 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08472954-97ba-48d5-8608-cb91e73f3153 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:17.826631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08472954-97ba-48d5-8608-cb91e73f3153 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:17.856094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-08472954-97ba-48d5-8608-cb91e73f3153 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042572 May 24 13:35:17.856631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 995/1997] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:17 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:18.868159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4b541be9-986b-49d9-8e7d-121d7d8d1960 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:18.869085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4b541be9-986b-49d9-8e7d-121d7d8d1960 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:18.875579 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4b541be9-986b-49d9-8e7d-121d7d8d1960 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:18.876028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4b541be9-986b-49d9-8e7d-121d7d8d1960 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:18.876791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4b541be9-986b-49d9-8e7d-121d7d8d1960 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:18.877227 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4b541be9-986b-49d9-8e7d-121d7d8d1960 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:18.906514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4b541be9-986b-49d9-8e7d-121d7d8d1960 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042829 May 24 13:35:18.907065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1003/1998] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:18 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:19.917572 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-43a1cbd2-9146-461e-9531-9c8af3190053 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:19.918472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-43a1cbd2-9146-461e-9531-9c8af3190053 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:19.924970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43a1cbd2-9146-461e-9531-9c8af3190053 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:19.925420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43a1cbd2-9146-461e-9531-9c8af3190053 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:19.926175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43a1cbd2-9146-461e-9531-9c8af3190053 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:19.926634 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43a1cbd2-9146-461e-9531-9c8af3190053 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:19.955593 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-43a1cbd2-9146-461e-9531-9c8af3190053 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042554 May 24 13:35:19.956155 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 996/1999] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:19 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:20.029172 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:35:20.029661 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:35:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:35:20.967145 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ba759542-1bd0-4564-823d-97dd08aec1ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:20.968019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ba759542-1bd0-4564-823d-97dd08aec1ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:20.974816 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ba759542-1bd0-4564-823d-97dd08aec1ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:20.975271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ba759542-1bd0-4564-823d-97dd08aec1ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:20.976038 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ba759542-1bd0-4564-823d-97dd08aec1ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:20.976482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ba759542-1bd0-4564-823d-97dd08aec1ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:21.005749 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ba759542-1bd0-4564-823d-97dd08aec1ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042657 May 24 13:35:21.006305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1004/2000] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:20 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:22.017944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca6c9895-4aad-415a-8fd5-908de0f8cede tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:22.018852 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ca6c9895-4aad-415a-8fd5-908de0f8cede tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:22.025905 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca6c9895-4aad-415a-8fd5-908de0f8cede tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:22.026388 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca6c9895-4aad-415a-8fd5-908de0f8cede tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:22.027159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca6c9895-4aad-415a-8fd5-908de0f8cede tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:22.027610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca6c9895-4aad-415a-8fd5-908de0f8cede tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:22.056654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ca6c9895-4aad-415a-8fd5-908de0f8cede tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042802 May 24 13:35:22.057193 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 997/2001] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:22 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:23.068189 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-24b5b560-42a9-4698-b54d-833a21ab0f5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:35:23.069125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-24b5b560-42a9-4698-b54d-833a21ab0f5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:23.075601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24b5b560-42a9-4698-b54d-833a21ab0f5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:23.076058 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24b5b560-42a9-4698-b54d-833a21ab0f5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:23.076819 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24b5b560-42a9-4698-b54d-833a21ab0f5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:23.077259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-24b5b560-42a9-4698-b54d-833a21ab0f5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:23.106788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-24b5b560-42a9-4698-b54d-833a21ab0f5b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042503 May 24 13:35:23.107347 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1005/2002] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:35:23 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:35:23.731852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:35:23.732079 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:35:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:35:24.117771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d1be25d5-359f-4616-9921-298bf81a0456 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:35:24.118735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d1be25d5-359f-4616-9921-298bf81a0456 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:35:24.125189 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1be25d5-359f-4616-9921-298bf81a0456 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:24.125632 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1be25d5-359f-4616-9921-298bf81a0456 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:24.126423 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1be25d5-359f-4616-9921-298bf81a0456 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:35:24.126856 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1be25d5-359f-4616-9921-298bf81a0456 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:35:24.190909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d1be25d5-359f-4616-9921-298bf81a0456 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "POST /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/action" status: 200 len: 41348 microversion: 2.1 time: 0.076824 May 24 13:35:24.191550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 998/2003] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:35:24 2022] POST /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1/action => generated 41348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:36:40.957315 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:36:40.958023 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:36:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:37:27.823683 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 24 13:37:27.824452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:37:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:38:20.724587 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:38:20.725153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:38:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:38:30.310129 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:38:30.310687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:38:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:38:40.036811 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:38:40.037404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:38:43.739492 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:38:43.740162 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:39:54.328046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1edc446e-99a8-47f5-83a1-692a07eca1d0] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 13:39:54.328822 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=15 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:39:54.329553 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=71 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:39:54.333568 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-047e0f7b-4412-44f5-8ebd-7884043176a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:39:54.334063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-047e0f7b-4412-44f5-8ebd-7884043176a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:39:54.342425 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-047e0f7b-4412-44f5-8ebd-7884043176a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:54.342886 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-047e0f7b-4412-44f5-8ebd-7884043176a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:54.343651 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-047e0f7b-4412-44f5-8ebd-7884043176a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:54.344090 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-047e0f7b-4412-44f5-8ebd-7884043176a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:54.368008 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-047e0f7b-4412-44f5-8ebd-7884043176a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Going to try to terminate instance {{(pid=117643) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:39:54.446770 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-047e0f7b-4412-44f5-8ebd-7884043176a7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 204 len: 0 microversion: 2.1 time: 0.119557 May 24 13:39:54.447504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1006/2004] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:39:54 2022] DELETE /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:39:54.454968 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41c46349-b9d7-4e27-abfc-1423f374e67f] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 13:39:54.455585 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=17 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:39:54.456425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=81 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:39:54.460967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fb8470f3-ad3d-4632-b2b5-d19fc7cb9e24 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:39:54.461687 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fb8470f3-ad3d-4632-b2b5-d19fc7cb9e24 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:39:54.470375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb8470f3-ad3d-4632-b2b5-d19fc7cb9e24 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:54.470826 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb8470f3-ad3d-4632-b2b5-d19fc7cb9e24 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:54.471598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb8470f3-ad3d-4632-b2b5-d19fc7cb9e24 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:54.472014 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb8470f3-ad3d-4632-b2b5-d19fc7cb9e24 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:54.724854 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fb8470f3-ad3d-4632-b2b5-d19fc7cb9e24 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:39:54.732426 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fb8470f3-ad3d-4632-b2b5-d19fc7cb9e24 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1681 microversion: 2.1 time: 0.280772 May 24 13:39:54.733060 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 999/2005] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:39:54 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:39:55.749895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-2f41aab2-57af-403f-b1f3-eafd60f83828 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:39:55.750646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-2f41aab2-57af-403f-b1f3-eafd60f83828 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:39:55.759780 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f41aab2-57af-403f-b1f3-eafd60f83828 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:55.760226 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f41aab2-57af-403f-b1f3-eafd60f83828 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:55.760987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f41aab2-57af-403f-b1f3-eafd60f83828 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:55.761416 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-2f41aab2-57af-403f-b1f3-eafd60f83828 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:55.764984 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] [1edc446e-99a8-47f5-83a1-692a07eca1d0] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 43308. May 24 13:39:55.930669 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-2f41aab2-57af-403f-b1f3-eafd60f83828 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:39:55.938173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-2f41aab2-57af-403f-b1f3-eafd60f83828 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 200 len: 1614 microversion: 2.1 time: 0.192523 May 24 13:39:55.938779 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1007/2006] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:39:55 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 1614 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:39:56.048803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] [41c46349-b9d7-4e27-abfc-1423f374e67f] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 43318. May 24 13:39:56.112733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-aeca2cc9-3b68-4432-9102-011e4ecaf48b req-a54ba730-4cab-4df7-834b-d894cb2f0210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50777b9e-1315-4cfc-a463-5a6fc3e6f6d3", "name": "network-vif-deleted", "tag": "9ddc296f-d30c-480d-9e9d-26c55cbee4fa"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:39:56.123386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-aeca2cc9-3b68-4432-9102-011e4ecaf48b req-a54ba730-4cab-4df7-834b-d894cb2f0210 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:56.123839 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-aeca2cc9-3b68-4432-9102-011e4ecaf48b req-a54ba730-4cab-4df7-834b-d894cb2f0210 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:56.135736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-aeca2cc9-3b68-4432-9102-011e4ecaf48b req-a54ba730-4cab-4df7-834b-d894cb2f0210 service nova] Creating event network-vif-deleted:9ddc296f-d30c-480d-9e9d-26c55cbee4fa for instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 on hv-cinder-84301 May 24 13:39:56.144802 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-aeca2cc9-3b68-4432-9102-011e4ecaf48b req-a54ba730-4cab-4df7-834b-d894cb2f0210 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112422 May 24 13:39:56.148828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1000/2007] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:39:56.955850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:39:56.956423 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:39:56.962880 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:56.963321 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:56.964074 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:56.964506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:56.978604 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] HTTP exception thrown: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Request method failure captured: May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 HTTP/1.1 May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNxWbgojkvVeYfqT7qAAM-63IKyOy4HuVQZHO3TkekbFkRqF4Z24zjaxBuqGxV8t8tOElHAT9A39AejgeB71yIFb-bN_wCaieFZ3ov3_opuWr_AuuR50Kdpbw8WF7BJ-d88iA06iZabGRwDSbBj-0N_G80A7xL4b8y33glGNhNaYVLc May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:39:56.980250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: e13a5203bc06439ba86befd2eb849ba5 May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:39:56.981991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '50777b9e-1315-4cfc-a463-5a6fc3e6f6d3'} May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:39:56.986519 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:39:56.988339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:39:56.989935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Returning 404 to user: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:39:56.989935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cc599b6b-00c6-44ef-b9c2-de0cd26adcb9 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 404 len: 111 microversion: 2.1 time: 0.029771 May 24 13:39:56.989935 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1008/2008] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:39:56 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:39:56.991286 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2e8caeb6-b01a-4dc3-b11e-1b9bc1540203 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '.version_select at 0x7f9a670abf70>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:39:57.013907 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2e8caeb6-b01a-4dc3-b11e-1b9bc1540203 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064986842" status: 202 len: 0 microversion: 2.1 time: 0.027031 May 24 13:39:57.018061 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1001/2009] 10.222.0.45 () {58 vars in 1220 bytes} [Tue May 24 13:39:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064986842 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 13:39:57.672018 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-776be2e0-0a0a-46ad-98a7-34602b52c629 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Action: 'create', calling method: .version_select at 0x7f9a65c8f4c0>, body: {"keypair": {"name": "tempest-keypair-319746584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvKPARzc4X/1qEoY1qBsdae4EHCP18j4SkgV06XG3lvT3VIcAw3ARu5wHshpbq2qGV2wMVsTYNqFc0/w5FTlzeRWcJKdrXVfyyC14bfkAKQSDkqsUNGwXo5JS4V0D1VQ=="}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:39:57.685998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-776be2e0-0a0a-46ad-98a7-34602b52c629 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for project cb54f85be3994a40a4b52e576b36c6da. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:39:57.689732 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-776be2e0-0a0a-46ad-98a7-34602b52c629 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for user e13a5203bc06439ba86befd2eb849ba5 and project cb54f85be3994a40a4b52e576b36c6da. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:39:57.714833 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-776be2e0-0a0a-46ad-98a7-34602b52c629 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046435 May 24 13:39:57.715411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1009/2010] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 13:39:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:39:58.924566 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-471293114", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb5c4934-469a-4d18-945a-966849c00eff"}], "security_groups": [{"name": "tempest-securitygroup--1933655636"}], "key_name": "tempest-keypair-319746584", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:39:59.024893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] validate_networks() for [('fb5c4934-469a-4d18-945a-966849c00eff', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:39:59.436456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:39:59.436882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:39:59.437359 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:39:59.437798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:39:59.438213 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:39:59.447681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:59.448129 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:59.448926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:39:59.449356 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:39:59.466462 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for project cb54f85be3994a40a4b52e576b36c6da. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:39:59.470458 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Getting quotas for user e13a5203bc06439ba86befd2eb849ba5 and project cb54f85be3994a40a4b52e576b36c6da. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:39:59.481420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:39:59.483716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:39:59.527538 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [448fb63c-1fc1-460d-82ee-6f9939dacf9a] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 13:40:00.535433 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [448fb63c-1fc1-460d-82ee-6f9939dacf9a] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 43368. May 24 13:40:00.539548 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d8f86839-67bd-44a5-a2c8-d5238e62231e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.619815 May 24 13:40:00.540197 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1002/2011] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:39:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:40:00.550905 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-070cce91-db10-4b31-80b1-2f78938e2bc4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:00.551645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-070cce91-db10-4b31-80b1-2f78938e2bc4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:00.605431 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-070cce91-db10-4b31-80b1-2f78938e2bc4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:00.611990 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-070cce91-db10-4b31-80b1-2f78938e2bc4 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1240 microversion: 2.1 time: 0.065857 May 24 13:40:00.612544 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1010/2012] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:00 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:01.628906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-52032240-4287-4ad0-8fb5-a92161c81789 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:01.629579 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-52032240-4287-4ad0-8fb5-a92161c81789 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:01.682875 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-52032240-4287-4ad0-8fb5-a92161c81789 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:01.689405 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-52032240-4287-4ad0-8fb5-a92161c81789 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1240 microversion: 2.1 time: 0.064804 May 24 13:40:01.689957 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1003/2013] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:01 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:02.709454 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3313635f-7a82-4503-8191-deca302d1e5e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:02.710220 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3313635f-7a82-4503-8191-deca302d1e5e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:02.763362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3313635f-7a82-4503-8191-deca302d1e5e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:02.770586 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3313635f-7a82-4503-8191-deca302d1e5e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1240 microversion: 2.1 time: 0.068146 May 24 13:40:02.771153 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1011/2014] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:02 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:03.787444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f7e62f46-98be-45e5-8e61-7444d1b48a2c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:03.787986 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f7e62f46-98be-45e5-8e61-7444d1b48a2c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:03.795291 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f7e62f46-98be-45e5-8e61-7444d1b48a2c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:03.795751 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f7e62f46-98be-45e5-8e61-7444d1b48a2c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:03.796519 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f7e62f46-98be-45e5-8e61-7444d1b48a2c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:03.798344 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f7e62f46-98be-45e5-8e61-7444d1b48a2c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:03.858361 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f7e62f46-98be-45e5-8e61-7444d1b48a2c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:03.865693 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f7e62f46-98be-45e5-8e61-7444d1b48a2c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1244 microversion: 2.1 time: 0.082150 May 24 13:40:03.866253 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1004/2015] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:03 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:04.882264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b7cdfa91-c906-4daa-8fc7-e44a28dd8ef7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:04.882963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b7cdfa91-c906-4daa-8fc7-e44a28dd8ef7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:04.890073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b7cdfa91-c906-4daa-8fc7-e44a28dd8ef7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:04.890546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b7cdfa91-c906-4daa-8fc7-e44a28dd8ef7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:04.891311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b7cdfa91-c906-4daa-8fc7-e44a28dd8ef7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:04.891746 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b7cdfa91-c906-4daa-8fc7-e44a28dd8ef7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:04.976198 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b7cdfa91-c906-4daa-8fc7-e44a28dd8ef7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:04.983623 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b7cdfa91-c906-4daa-8fc7-e44a28dd8ef7 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1298 microversion: 2.1 time: 0.105319 May 24 13:40:04.984178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1012/2016] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:04 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:05.865033 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-a0011230-6a3d-45e6-a061-d8779a695a18 req-8413d999-1eff-4b57-a39b-92659a455153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90bce1b-c32a-404b-83b9-b9dd4431bba3", "tag": "290351db-4d2e-480a-8d2c-7cfc177f2261"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:40:05.877248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a0011230-6a3d-45e6-a061-d8779a695a18 req-8413d999-1eff-4b57-a39b-92659a455153 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:05.878113 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a0011230-6a3d-45e6-a061-d8779a695a18 req-8413d999-1eff-4b57-a39b-92659a455153 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:05.898121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-a0011230-6a3d-45e6-a061-d8779a695a18 req-8413d999-1eff-4b57-a39b-92659a455153 service nova] Creating event network-changed:290351db-4d2e-480a-8d2c-7cfc177f2261 for instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 on hv-cinder-84301 May 24 13:40:05.903774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-a0011230-6a3d-45e6-a061-d8779a695a18 req-8413d999-1eff-4b57-a39b-92659a455153 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043797 May 24 13:40:05.904940 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1005/2017] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:40:06.000637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8724279a-72d9-442d-b6c7-914a3f48e677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:06.001292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8724279a-72d9-442d-b6c7-914a3f48e677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:06.008891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8724279a-72d9-442d-b6c7-914a3f48e677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:06.009339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8724279a-72d9-442d-b6c7-914a3f48e677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:06.010121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8724279a-72d9-442d-b6c7-914a3f48e677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:06.010758 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8724279a-72d9-442d-b6c7-914a3f48e677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:06.214962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8724279a-72d9-442d-b6c7-914a3f48e677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:06.222271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8724279a-72d9-442d-b6c7-914a3f48e677 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1366 microversion: 2.1 time: 0.225574 May 24 13:40:06.223210 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1013/2018] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:05 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:07.241040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-23ad73a3-3d0c-4123-be19-40d54ce7742b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:07.241639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-23ad73a3-3d0c-4123-be19-40d54ce7742b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:07.247944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23ad73a3-3d0c-4123-be19-40d54ce7742b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:07.248391 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23ad73a3-3d0c-4123-be19-40d54ce7742b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:07.249152 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23ad73a3-3d0c-4123-be19-40d54ce7742b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:07.249583 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23ad73a3-3d0c-4123-be19-40d54ce7742b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:07.380369 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-23ad73a3-3d0c-4123-be19-40d54ce7742b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:07.388516 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-23ad73a3-3d0c-4123-be19-40d54ce7742b tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1366 microversion: 2.1 time: 0.152241 May 24 13:40:07.389073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1006/2019] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:07 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:08.405361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d0d681bf-a57e-4cd4-8557-028284e96e71 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:08.406008 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d0d681bf-a57e-4cd4-8557-028284e96e71 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:08.413723 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0d681bf-a57e-4cd4-8557-028284e96e71 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:08.414173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0d681bf-a57e-4cd4-8557-028284e96e71 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:08.415643 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0d681bf-a57e-4cd4-8557-028284e96e71 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:08.416082 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d0d681bf-a57e-4cd4-8557-028284e96e71 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:08.638852 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-d0d681bf-a57e-4cd4-8557-028284e96e71 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:08.646741 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d0d681bf-a57e-4cd4-8557-028284e96e71 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1366 microversion: 2.1 time: 0.245191 May 24 13:40:08.647408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1014/2020] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:08 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:09.664175 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2b97876a-8040-40bb-b91c-618e0d7e035d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:09.665284 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2b97876a-8040-40bb-b91c-618e0d7e035d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:09.667731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:40:09.673383 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b97876a-8040-40bb-b91c-618e0d7e035d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:09.673837 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b97876a-8040-40bb-b91c-618e0d7e035d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:09.674646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b97876a-8040-40bb-b91c-618e0d7e035d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:09.675082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b97876a-8040-40bb-b91c-618e0d7e035d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:09.809378 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2b97876a-8040-40bb-b91c-618e0d7e035d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:09.816828 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2b97876a-8040-40bb-b91c-618e0d7e035d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1366 microversion: 2.1 time: 0.156572 May 24 13:40:09.817480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1007/2021] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:09 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:10.832551 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-f8fce38e-a60c-4dac-8608-85fcb83bc563 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:10.833163 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-f8fce38e-a60c-4dac-8608-85fcb83bc563 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:10.840484 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8fce38e-a60c-4dac-8608-85fcb83bc563 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:10.840934 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8fce38e-a60c-4dac-8608-85fcb83bc563 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:10.841683 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8fce38e-a60c-4dac-8608-85fcb83bc563 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:10.842115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-f8fce38e-a60c-4dac-8608-85fcb83bc563 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:10.967488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-f8fce38e-a60c-4dac-8608-85fcb83bc563 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:10.974788 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-f8fce38e-a60c-4dac-8608-85fcb83bc563 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1366 microversion: 2.1 time: 0.146040 May 24 13:40:10.975297 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1015/2022] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:10 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:11.687374 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=8 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:40:11.707859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-d9e9dff6-ff6d-49b2-80d2-249d1ec3c976 req-337900a8-d3f7-44d3-9ff0-5d71df2c4c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90bce1b-c32a-404b-83b9-b9dd4431bba3", "name": "network-vif-plugged", "status": "completed", "tag": "290351db-4d2e-480a-8d2c-7cfc177f2261"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:40:11.716794 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d9e9dff6-ff6d-49b2-80d2-249d1ec3c976 req-337900a8-d3f7-44d3-9ff0-5d71df2c4c89 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:11.717240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d9e9dff6-ff6d-49b2-80d2-249d1ec3c976 req-337900a8-d3f7-44d3-9ff0-5d71df2c4c89 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:11.730164 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-d9e9dff6-ff6d-49b2-80d2-249d1ec3c976 req-337900a8-d3f7-44d3-9ff0-5d71df2c4c89 service nova] Creating event network-vif-plugged:290351db-4d2e-480a-8d2c-7cfc177f2261 for instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 on hv-cinder-84301 May 24 13:40:11.735156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-d9e9dff6-ff6d-49b2-80d2-249d1ec3c976 req-337900a8-d3f7-44d3-9ff0-5d71df2c4c89 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087100 May 24 13:40:11.735726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1008/2023] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:40:11.991062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-191bec2b-bda0-44a5-ad69-77d96958cdca tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:11.991680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-191bec2b-bda0-44a5-ad69-77d96958cdca tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:11.998121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-191bec2b-bda0-44a5-ad69-77d96958cdca tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:11.998602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-191bec2b-bda0-44a5-ad69-77d96958cdca tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:11.999358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-191bec2b-bda0-44a5-ad69-77d96958cdca tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:11.999795 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-191bec2b-bda0-44a5-ad69-77d96958cdca tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:12.129434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-191bec2b-bda0-44a5-ad69-77d96958cdca tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:12.137776 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-191bec2b-bda0-44a5-ad69-77d96958cdca tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1366 microversion: 2.1 time: 0.150562 May 24 13:40:12.138354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1016/2024] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:11 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:13.155917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aad83a65-d351-4374-ab98-d1633f0d404c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:13.156621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aad83a65-d351-4374-ab98-d1633f0d404c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:13.163046 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aad83a65-d351-4374-ab98-d1633f0d404c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:13.163497 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aad83a65-d351-4374-ab98-d1633f0d404c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:13.165377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aad83a65-d351-4374-ab98-d1633f0d404c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:13.165377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aad83a65-d351-4374-ab98-d1633f0d404c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:13.295008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-aad83a65-d351-4374-ab98-d1633f0d404c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:13.302444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aad83a65-d351-4374-ab98-d1633f0d404c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1366 microversion: 2.1 time: 0.151113 May 24 13:40:13.303008 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1009/2025] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:13 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:14.319014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-3efca64c-a7db-46a5-b79f-3da433be7c3d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:14.319641 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-3efca64c-a7db-46a5-b79f-3da433be7c3d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:14.321467 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=8 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:40:14.327111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3efca64c-a7db-46a5-b79f-3da433be7c3d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:14.327561 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3efca64c-a7db-46a5-b79f-3da433be7c3d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:14.328317 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3efca64c-a7db-46a5-b79f-3da433be7c3d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:14.328755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-3efca64c-a7db-46a5-b79f-3da433be7c3d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:14.467333 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-3efca64c-a7db-46a5-b79f-3da433be7c3d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:40:14.474807 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-3efca64c-a7db-46a5-b79f-3da433be7c3d tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1557 microversion: 2.1 time: 0.159692 May 24 13:40:14.475370 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1017/2026] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:40:14 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:40:14.491240 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-68dd7f1d-bf07-4735-8054-8f7a2f77df5c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:40:14.491741 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-68dd7f1d-bf07-4735-8054-8f7a2f77df5c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:40:14.498173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68dd7f1d-bf07-4735-8054-8f7a2f77df5c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:14.498646 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68dd7f1d-bf07-4735-8054-8f7a2f77df5c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:14.499425 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68dd7f1d-bf07-4735-8054-8f7a2f77df5c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:14.499857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68dd7f1d-bf07-4735-8054-8f7a2f77df5c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:14.578559 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-68dd7f1d-bf07-4735-8054-8f7a2f77df5c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090964 May 24 13:40:14.579146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1010/2027] 10.222.0.45 () {58 vars in 1274 bytes} [Tue May 24 13:40:14 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:40:15.537894 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-bc435fe6-2cc6-4ad4-a865-31d736cd8e48 req-1a92a8d6-1282-40e6-b776-33b37cbd2008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90bce1b-c32a-404b-83b9-b9dd4431bba3", "tag": "290351db-4d2e-480a-8d2c-7cfc177f2261"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:40:15.546391 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-bc435fe6-2cc6-4ad4-a865-31d736cd8e48 req-1a92a8d6-1282-40e6-b776-33b37cbd2008 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:40:15.546838 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-bc435fe6-2cc6-4ad4-a865-31d736cd8e48 req-1a92a8d6-1282-40e6-b776-33b37cbd2008 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:40:15.558638 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-bc435fe6-2cc6-4ad4-a865-31d736cd8e48 req-1a92a8d6-1282-40e6-b776-33b37cbd2008 service nova] Creating event network-changed:290351db-4d2e-480a-8d2c-7cfc177f2261 for instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 on hv-cinder-84301 May 24 13:40:15.564197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-bc435fe6-2cc6-4ad4-a865-31d736cd8e48 req-1a92a8d6-1282-40e6-b776-33b37cbd2008 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088298 May 24 13:40:15.564866 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1018/2028] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:20.085539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:41:20.086296 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=42 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:41:20.090853 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5e34070b-4bdc-40df-a59d-0a409c14fbd2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:20.091377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5e34070b-4bdc-40df-a59d-0a409c14fbd2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:20.098863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e34070b-4bdc-40df-a59d-0a409c14fbd2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:20.099304 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e34070b-4bdc-40df-a59d-0a409c14fbd2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:20.100054 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e34070b-4bdc-40df-a59d-0a409c14fbd2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:20.100985 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e34070b-4bdc-40df-a59d-0a409c14fbd2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:20.124424 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5e34070b-4bdc-40df-a59d-0a409c14fbd2 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/ips" status: 200 len: 150 microversion: 2.1 time: 0.040856 May 24 13:41:20.124978 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1011/2029] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 13:41:20 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:21.433601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:41:21.434354 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:41:21.439141 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-56fa4134-ca55-4bf7-8831-4b3a1ca6d554 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b03721a-1c60-4bd3-bb04-3655f58dc5ae"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:41:21.440277 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-56fa4134-ca55-4bf7-8831-4b3a1ca6d554 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:21.448626 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56fa4134-ca55-4bf7-8831-4b3a1ca6d554 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:21.449246 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56fa4134-ca55-4bf7-8831-4b3a1ca6d554 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:21.450192 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56fa4134-ca55-4bf7-8831-4b3a1ca6d554 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:21.450720 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-56fa4134-ca55-4bf7-8831-4b3a1ca6d554 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:21.696742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-56fa4134-ca55-4bf7-8831-4b3a1ca6d554 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "POST /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265160 May 24 13:41:21.697808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1019/2030] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 13:41:21 2022] POST /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:24.497424 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bfbca658-472c-495e-89f8-413adfd29dd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:24.497971 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bfbca658-472c-495e-89f8-413adfd29dd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:24.504326 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfbca658-472c-495e-89f8-413adfd29dd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:24.504774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfbca658-472c-495e-89f8-413adfd29dd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:24.505530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfbca658-472c-495e-89f8-413adfd29dd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:24.505967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfbca658-472c-495e-89f8-413adfd29dd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:24.530328 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bfbca658-472c-495e-89f8-413adfd29dd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:41:24.605285 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bfbca658-472c-495e-89f8-413adfd29dd2 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "DELETE /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 204 len: 0 microversion: 2.1 time: 0.111361 May 24 13:41:24.606070 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1012/2031] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:41:24 2022] DELETE /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:41:24.615186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-317c3dcf-df36-45f1-ae19-1bcded40cc60 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:24.616464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-317c3dcf-df36-45f1-ae19-1bcded40cc60 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:24.622737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-317c3dcf-df36-45f1-ae19-1bcded40cc60 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:24.623196 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-317c3dcf-df36-45f1-ae19-1bcded40cc60 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:24.623964 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-317c3dcf-df36-45f1-ae19-1bcded40cc60 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:24.624407 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-317c3dcf-df36-45f1-ae19-1bcded40cc60 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:24.757125 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-317c3dcf-df36-45f1-ae19-1bcded40cc60 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:41:24.765607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-317c3dcf-df36-45f1-ae19-1bcded40cc60 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1766 microversion: 2.1 time: 0.155105 May 24 13:41:24.766178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1020/2032] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:24 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1766 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:41:25.783444 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0479c819-d614-4e79-adba-e69a65a90295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:25.784144 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0479c819-d614-4e79-adba-e69a65a90295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:25.791417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0479c819-d614-4e79-adba-e69a65a90295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:25.791863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0479c819-d614-4e79-adba-e69a65a90295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:25.792621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0479c819-d614-4e79-adba-e69a65a90295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:25.793050 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0479c819-d614-4e79-adba-e69a65a90295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:25.927811 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0479c819-d614-4e79-adba-e69a65a90295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:41:25.936402 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0479c819-d614-4e79-adba-e69a65a90295 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1766 microversion: 2.1 time: 0.157108 May 24 13:41:25.937159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1013/2033] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:25 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1766 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:41:26.774194 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-32d0ae97-eee2-4f1e-b976-0fab52c44ea7 req-8e8516f3-9d53-4dd1-b834-89cfb181e832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e87855-d184-4691-9f6b-40e2b7d023d1", "name": "network-vif-deleted", "tag": "db9d7b26-9bf6-4842-89a1-604c6eb29592"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:41:26.784211 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-32d0ae97-eee2-4f1e-b976-0fab52c44ea7 req-8e8516f3-9d53-4dd1-b834-89cfb181e832 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:26.784655 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-32d0ae97-eee2-4f1e-b976-0fab52c44ea7 req-8e8516f3-9d53-4dd1-b834-89cfb181e832 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:26.796953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-32d0ae97-eee2-4f1e-b976-0fab52c44ea7 req-8e8516f3-9d53-4dd1-b834-89cfb181e832 service nova] Creating event network-vif-deleted:db9d7b26-9bf6-4842-89a1-604c6eb29592 for instance 48e87855-d184-4691-9f6b-40e2b7d023d1 on hv-cinder-84301 May 24 13:41:26.803983 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-32d0ae97-eee2-4f1e-b976-0fab52c44ea7 req-8e8516f3-9d53-4dd1-b834-89cfb181e832 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032821 May 24 13:41:26.804589 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1021/2034] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:26.955546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7ef998b5-04a8-47dc-8041-71bbced72872 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:26.961055 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7ef998b5-04a8-47dc-8041-71bbced72872 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:26.970972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ef998b5-04a8-47dc-8041-71bbced72872 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:26.971420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ef998b5-04a8-47dc-8041-71bbced72872 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:26.973575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ef998b5-04a8-47dc-8041-71bbced72872 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:26.978372 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ef998b5-04a8-47dc-8041-71bbced72872 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:27.049056 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7ef998b5-04a8-47dc-8041-71bbced72872 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:41:27.058946 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7ef998b5-04a8-47dc-8041-71bbced72872 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1416 microversion: 2.1 time: 0.108872 May 24 13:41:27.059675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1014/2035] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:26 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1416 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:41:28.076687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:28.077382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:28.083665 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:28.084117 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:28.084910 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:28.085351 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:28.115355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:28.116318 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:28.116814 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.objects.instance [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lazy-loading 'fault' on Instance uuid 48e87855-d184-4691-9f6b-40e2b7d023d1 {{(pid=117643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:41:28.158535 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d46a7a0ae40e9b157b7199b18de27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728de65d013a489594d837589c7b978b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:41:28.167645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e1593148-e2d4-49c0-97d6-2d5c292d2c7a tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 200 len: 1510 microversion: 2.1 time: 0.095535 May 24 13:41:28.168223 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1022/2036] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:28 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 1510 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:41:29.185036 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:29.185568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:29.192021 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:29.192472 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:29.193272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:29.194220 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:29.210524 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] HTTP exception thrown: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Request method failure captured: May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 HTTP/1.1 May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNbfqW4vUG_9aIlXYzCBVkliEqdErqpH0IfBp99DgZNNPcUUq8SNc-8PheLvWrZcYDu0QF9LvDb-9YchpZjYc-Yirqch7ELpLxT2va1NN1JUSRGFzEj38M_QXwStFjiRXAyE0EEe0JcHTCFl8XofSjI9xskoaSWzpUBAa0eVh1H7iAA May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 728de65d013a489594d837589c7b978b May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:41:29.212171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/728de65d013a489594d837589c7b978b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_728de65d013a489594d837589c7b978b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 728de65d013a489594d837589c7b978b May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: cb3d46a7a0ae40e9b157b7199b18de27 May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:29.214059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '48e87855-d184-4691-9f6b-40e2b7d023d1'} May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:29.215137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:29.216688 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:29.218044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Returning 404 to user: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:29.218044 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-175c4e43-7716-4e40-a638-5bb702e2322b tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 404 len: 111 microversion: 2.1 time: 0.032992 May 24 13:41:29.218242 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1015/2037] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:29 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:29.223453 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-cccf6407-0656-4ec0-a8db-8a656b451764 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '.version_select at 0x7f9a6b8d4ee0>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:29.241190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-cccf6407-0656-4ec0-a8db-8a656b451764 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-471226213" status: 202 len: 0 microversion: 2.1 time: 0.021415 May 24 13:41:29.241839 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1023/2038] 10.222.0.45 () {58 vars in 1217 bytes} [Tue May 24 13:41:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-471226213 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:41:29.316191 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b272660f-a8fb-404e-875d-d136118665b0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:29.316722 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b272660f-a8fb-404e-875d-d136118665b0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:29.323605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b272660f-a8fb-404e-875d-d136118665b0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:29.324076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b272660f-a8fb-404e-875d-d136118665b0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:29.324847 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b272660f-a8fb-404e-875d-d136118665b0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:29.325289 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b272660f-a8fb-404e-875d-d136118665b0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:29.449076 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-b272660f-a8fb-404e-875d-d136118665b0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lazy-loading 'services' on Instance uuid c90bce1b-c32a-404b-83b9-b9dd4431bba3 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:41:29.538041 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b272660f-a8fb-404e-875d-d136118665b0 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-volume_attachments/2b03721a-1c60-4bd3-bb04-3655f58dc5ae" status: 202 len: 0 microversion: 2.1 time: 0.225528 May 24 13:41:29.538944 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1016/2039] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 13:41:29 2022] DELETE /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-volume_attachments/2b03721a-1c60-4bd3-bb04-3655f58dc5ae => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:41:29.547899 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0845bc30-da33-4381-b955-b8cbd2206090 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:29.548833 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0845bc30-da33-4381-b955-b8cbd2206090 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:29.557233 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0845bc30-da33-4381-b955-b8cbd2206090 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:29.557823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0845bc30-da33-4381-b955-b8cbd2206090 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:29.558674 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0845bc30-da33-4381-b955-b8cbd2206090 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:29.559115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0845bc30-da33-4381-b955-b8cbd2206090 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:29.592891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0845bc30-da33-4381-b955-b8cbd2206090 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049313 May 24 13:41:29.593536 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1024/2040] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:41:29 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:41:30.605804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-879f28e3-ede9-42a2-b8dd-1cdefd0d0a47 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:30.606950 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-879f28e3-ede9-42a2-b8dd-1cdefd0d0a47 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:30.613850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-879f28e3-ede9-42a2-b8dd-1cdefd0d0a47 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:30.614328 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-879f28e3-ede9-42a2-b8dd-1cdefd0d0a47 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:30.615131 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-879f28e3-ede9-42a2-b8dd-1cdefd0d0a47 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:30.616161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-879f28e3-ede9-42a2-b8dd-1cdefd0d0a47 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:30.643872 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-879f28e3-ede9-42a2-b8dd-1cdefd0d0a47 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042481 May 24 13:41:30.644351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1017/2041] 10.222.0.45 () {58 vars in 1301 bytes} [Tue May 24 13:41:30 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 13:41:30.702717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-71fd13f1-f77e-4db4-a5eb-cde013d283fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:30.703239 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-71fd13f1-f77e-4db4-a5eb-cde013d283fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:30.709691 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71fd13f1-f77e-4db4-a5eb-cde013d283fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:30.710144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71fd13f1-f77e-4db4-a5eb-cde013d283fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:30.710950 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71fd13f1-f77e-4db4-a5eb-cde013d283fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:30.711396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-71fd13f1-f77e-4db4-a5eb-cde013d283fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:30.736378 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-71fd13f1-f77e-4db4-a5eb-cde013d283fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Going to try to terminate instance {{(pid=117643) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:41:30.809958 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-71fd13f1-f77e-4db4-a5eb-cde013d283fb tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 204 len: 0 microversion: 2.1 time: 0.110495 May 24 13:41:30.811385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1025/2042] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:41:30 2022] DELETE /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:41:30.821797 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b112a490-0d60-4ae6-9a16-9785a1510926 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:30.822416 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b112a490-0d60-4ae6-9a16-9785a1510926 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:30.829394 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b112a490-0d60-4ae6-9a16-9785a1510926 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:30.829857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b112a490-0d60-4ae6-9a16-9785a1510926 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:30.831747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b112a490-0d60-4ae6-9a16-9785a1510926 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:30.832282 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b112a490-0d60-4ae6-9a16-9785a1510926 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:30.962799 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b112a490-0d60-4ae6-9a16-9785a1510926 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:41:30.970184 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b112a490-0d60-4ae6-9a16-9785a1510926 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1681 microversion: 2.1 time: 0.154378 May 24 13:41:30.970784 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1018/2043] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:30 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:41:31.988005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6280c955-a7fc-4f69-8e73-0b8b34455936 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:31.988656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6280c955-a7fc-4f69-8e73-0b8b34455936 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:31.997190 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6280c955-a7fc-4f69-8e73-0b8b34455936 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:31.997638 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6280c955-a7fc-4f69-8e73-0b8b34455936 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:31.998418 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6280c955-a7fc-4f69-8e73-0b8b34455936 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:31.998853 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6280c955-a7fc-4f69-8e73-0b8b34455936 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:32.126027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6280c955-a7fc-4f69-8e73-0b8b34455936 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:41:32.133557 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6280c955-a7fc-4f69-8e73-0b8b34455936 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1681 microversion: 2.1 time: 0.149833 May 24 13:41:32.134112 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1026/2044] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:31 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:41:32.461496 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:32.461984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:32.468839 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:32.469288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:32.470047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:32.470520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:32.491418 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] HTTP exception thrown: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Request method failure captured: May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 HTTP/1.1 May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNbfqW4vUG_9aIlXYzCBVkliEqdErqpH0IfBp99DgZNNPcUUq8SNc-8PheLvWrZcYDu0QF9LvDb-9YchpZjYc-Yirqch7ELpLxT2va1NN1JUSRGFzEj38M_QXwStFjiRXAyE0EEe0JcHTCFl8XofSjI9xskoaSWzpUBAa0eVh1H7iAA May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 728de65d013a489594d837589c7b978b May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:41:32.493110 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/728de65d013a489594d837589c7b978b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_728de65d013a489594d837589c7b978b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 728de65d013a489594d837589c7b978b May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: cb3d46a7a0ae40e9b157b7199b18de27 May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.494928 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '48e87855-d184-4691-9f6b-40e2b7d023d1'} May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:32.496069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.497813 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:32.499364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Returning 404 to user: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:32.499364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-95fe5ac9-6091-4842-8bbe-11329c9caa90 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "DELETE /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 404 len: 111 microversion: 2.1 time: 0.037437 May 24 13:41:32.499364 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1019/2045] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:41:32 2022] DELETE /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:32.502897 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:32.503528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: 48e87855-d184-4691-9f6b-40e2b7d023d1] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:32.509623 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:32.510073 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:32.510868 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:32.511307 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:32.524882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] HTTP exception thrown: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Request method failure captured: May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 HTTP/1.1 May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbfqW4vUG_9aIlXYzCBVkliEqdErqpH0IfBp99DgZNNPcUUq8SNc-8PheLvWrZcYDu0QF9LvDb-9YchpZjYc-Yirqch7ELpLxT2va1NN1JUSRGFzEj38M_QXwStFjiRXAyE0EEe0JcHTCFl8XofSjI9xskoaSWzpUBAa0eVh1H7iAA May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 728de65d013a489594d837589c7b978b May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:41:32.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/728de65d013a489594d837589c7b978b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_728de65d013a489594d837589c7b978b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 728de65d013a489594d837589c7b978b May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: cb3d46a7a0ae40e9b157b7199b18de27 May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.528312 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '48e87855-d184-4691-9f6b-40e2b7d023d1'} May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:32.529328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. May 24 13:41:32.531000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:32.532488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Returning 404 to user: Instance 48e87855-d184-4691-9f6b-40e2b7d023d1 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:32.532488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-634233ec-6f42-493e-8946-2e6047633415 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1" status: 404 len: 111 microversion: 2.1 time: 0.028816 May 24 13:41:32.532488 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1027/2046] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:32 2022] GET /compute/v2.1/servers/48e87855-d184-4691-9f6b-40e2b7d023d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:33.149726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a08dd65f-01b3-42f7-93a1-433a1cbb290e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:33.150680 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a08dd65f-01b3-42f7-93a1-433a1cbb290e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:33.156776 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a08dd65f-01b3-42f7-93a1-433a1cbb290e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:33.157298 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a08dd65f-01b3-42f7-93a1-433a1cbb290e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:33.158073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a08dd65f-01b3-42f7-93a1-433a1cbb290e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:33.158534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a08dd65f-01b3-42f7-93a1-433a1cbb290e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:33.289510 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a08dd65f-01b3-42f7-93a1-433a1cbb290e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13a5203bc06439ba86befd2eb849ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb54f85be3994a40a4b52e576b36c6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:41:33.297411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a08dd65f-01b3-42f7-93a1-433a1cbb290e tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 200 len: 1681 microversion: 2.1 time: 0.151316 May 24 13:41:33.298261 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1020/2047] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:33 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:41:33.559820 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-957e1484-6953-495e-9b6a-f6212909a8a8 req-fc2449ce-3bae-43a4-99d4-6136db086244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90bce1b-c32a-404b-83b9-b9dd4431bba3", "name": "network-vif-deleted", "tag": "290351db-4d2e-480a-8d2c-7cfc177f2261"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:41:33.570561 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-957e1484-6953-495e-9b6a-f6212909a8a8 req-fc2449ce-3bae-43a4-99d4-6136db086244 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:33.571104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-957e1484-6953-495e-9b6a-f6212909a8a8 req-fc2449ce-3bae-43a4-99d4-6136db086244 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:33.583971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-957e1484-6953-495e-9b6a-f6212909a8a8 req-fc2449ce-3bae-43a4-99d4-6136db086244 service nova] Creating event network-vif-deleted:290351db-4d2e-480a-8d2c-7cfc177f2261 for instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 on hv-cinder-84301 May 24 13:41:33.590653 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-957e1484-6953-495e-9b6a-f6212909a8a8 req-fc2449ce-3bae-43a4-99d4-6136db086244 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034489 May 24 13:41:33.591256 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1028/2048] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:33.668292 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:33.668787 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:33.675875 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:33.676508 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:33.677467 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:33.678744 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:33.695060 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] HTTP exception thrown: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Request method failure captured: May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d HTTP/1.1 May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNbfqW4vUG_9aIlXYzCBVkliEqdErqpH0IfBp99DgZNNPcUUq8SNc-8PheLvWrZcYDu0QF9LvDb-9YchpZjYc-Yirqch7ELpLxT2va1NN1JUSRGFzEj38M_QXwStFjiRXAyE0EEe0JcHTCFl8XofSjI9xskoaSWzpUBAa0eVh1H7iAA May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 728de65d013a489594d837589c7b978b May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:41:33.696735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/728de65d013a489594d837589c7b978b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_728de65d013a489594d837589c7b978b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 728de65d013a489594d837589c7b978b May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: cb3d46a7a0ae40e9b157b7199b18de27 May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.698024 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'dc6db3c9-4cac-4157-ba43-3c425854302d'} May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:33.698974 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.702988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:33.704079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Returning 404 to user: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:33.704079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2cfee0d7-5c7f-48df-830b-550b2736d7ee tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 404 len: 111 microversion: 2.1 time: 0.034692 May 24 13:41:33.704079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1021/2049] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:41:33 2022] DELETE /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:33.709266 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:33.710095 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] [instance: dc6db3c9-4cac-4157-ba43-3c425854302d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:33.717313 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:33.718472 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:33.719343 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:33.719891 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:33.735479 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] HTTP exception thrown: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Request method failure captured: May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d HTTP/1.1 May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNbfqW4vUG_9aIlXYzCBVkliEqdErqpH0IfBp99DgZNNPcUUq8SNc-8PheLvWrZcYDu0QF9LvDb-9YchpZjYc-Yirqch7ELpLxT2va1NN1JUSRGFzEj38M_QXwStFjiRXAyE0EEe0JcHTCFl8XofSjI9xskoaSWzpUBAa0eVh1H7iAA May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 728de65d013a489594d837589c7b978b May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:41:33.737148 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/728de65d013a489594d837589c7b978b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_728de65d013a489594d837589c7b978b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/728de65d013a489594d837589c7b978b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 728de65d013a489594d837589c7b978b May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1500266109 May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: cb3d46a7a0ae40e9b157b7199b18de27 May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeTestJSON-1500266109-project May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.738406 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': 'dc6db3c9-4cac-4157-ba43-3c425854302d'} May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:33.739120 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. May 24 13:41:33.740346 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:33.741963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] Returning 404 to user: Instance dc6db3c9-4cac-4157-ba43-3c425854302d could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:33.741963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-35809c3e-f7b6-4074-bbed-2b6d51c9a1d1 tempest-AttachVolumeTestJSON-1500266109 tempest-AttachVolumeTestJSON-1500266109-project] 10.222.0.45 "GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d" status: 404 len: 111 microversion: 2.1 time: 0.033487 May 24 13:41:33.741963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1029/2050] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:33 2022] GET /compute/v2.1/servers/dc6db3c9-4cac-4157-ba43-3c425854302d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:34.314830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:34.315452 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:34.322047 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:34.322547 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:34.323580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:34.324019 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:34.339096 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] HTTP exception thrown: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Request method failure captured: May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 HTTP/1.1 May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNxWbgojkvVeYfqT7qAAM-63IKyOy4HuVQZHO3TkekbFkRqF4Z24zjaxBuqGxV8t8tOElHAT9A39AejgeB71yIFb-bN_wCaieFZ3ov3_opuWr_AuuR50Kdpbw8WF7BJ-d88iA06iZabGRwDSbBj-0N_G80A7xL4b8y33glGNhNaYVLc May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:41:34.340658 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: e13a5203bc06439ba86befd2eb849ba5 May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:34.341830 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'c90bce1b-c32a-404b-83b9-b9dd4431bba3'} May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:34.342610 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:34.343669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:34.344662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Returning 404 to user: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:34.344662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-591b285c-001f-4643-ba2a-a71ad4c17b76 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 404 len: 111 microversion: 2.1 time: 0.031204 May 24 13:41:34.346079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1022/2051] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:34 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:34.351638 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-25aa3575-7e90-41ff-91f5-7bbce0dd45d6 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '.version_select at 0x7f9a6b8e2d30>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:34.371303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-25aa3575-7e90-41ff-91f5-7bbce0dd45d6 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319746584" status: 202 len: 0 microversion: 2.1 time: 0.023911 May 24 13:41:34.371918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1030/2052] 10.222.0.45 () {58 vars in 1217 bytes} [Tue May 24 13:41:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319746584 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:41:36.732257 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:36.732803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:36.739345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:36.739859 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:36.741272 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:36.741698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:36.754948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] HTTP exception thrown: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Request method failure captured: May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 HTTP/1.1 May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNxWbgojkvVeYfqT7qAAM-63IKyOy4HuVQZHO3TkekbFkRqF4Z24zjaxBuqGxV8t8tOElHAT9A39AejgeB71yIFb-bN_wCaieFZ3ov3_opuWr_AuuR50Kdpbw8WF7BJ-d88iA06iZabGRwDSbBj-0N_G80A7xL4b8y33glGNhNaYVLc May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:41:36.756565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: e13a5203bc06439ba86befd2eb849ba5 May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.757753 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'c90bce1b-c32a-404b-83b9-b9dd4431bba3'} May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:36.758396 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.761487 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:36.762635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Returning 404 to user: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:36.762635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a4842f7-a25d-4e40-aca4-1a8e21706462 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 404 len: 111 microversion: 2.1 time: 0.029608 May 24 13:41:36.762635 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1023/2053] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:41:36 2022] DELETE /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:36.768501 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:36.769121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: c90bce1b-c32a-404b-83b9-b9dd4431bba3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:36.777236 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:36.777687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:36.778487 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:36.778917 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:36.792548 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] HTTP exception thrown: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Request method failure captured: May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 HTTP/1.1 May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNxWbgojkvVeYfqT7qAAM-63IKyOy4HuVQZHO3TkekbFkRqF4Z24zjaxBuqGxV8t8tOElHAT9A39AejgeB71yIFb-bN_wCaieFZ3ov3_opuWr_AuuR50Kdpbw8WF7BJ-d88iA06iZabGRwDSbBj-0N_G80A7xL4b8y33glGNhNaYVLc May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:41:36.794104 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: e13a5203bc06439ba86befd2eb849ba5 May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.795465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': 'c90bce1b-c32a-404b-83b9-b9dd4431bba3'} May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:36.796193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. May 24 13:41:36.797320 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:36.798647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Returning 404 to user: Instance c90bce1b-c32a-404b-83b9-b9dd4431bba3 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:36.798647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-029b41f5-cca9-493d-ba0b-83102140b129 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3" status: 404 len: 111 microversion: 2.1 time: 0.031610 May 24 13:41:36.798647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1031/2054] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:36 2022] GET /compute/v2.1/servers/c90bce1b-c32a-404b-83b9-b9dd4431bba3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:37.949036 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:37.949524 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:37.955926 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:37.956371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:37.963637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:37.963637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:37.971885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] HTTP exception thrown: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Request method failure captured: May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 HTTP/1.1 May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNxWbgojkvVeYfqT7qAAM-63IKyOy4HuVQZHO3TkekbFkRqF4Z24zjaxBuqGxV8t8tOElHAT9A39AejgeB71yIFb-bN_wCaieFZ3ov3_opuWr_AuuR50Kdpbw8WF7BJ-d88iA06iZabGRwDSbBj-0N_G80A7xL4b8y33glGNhNaYVLc May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:41:37.973427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: e13a5203bc06439ba86befd2eb849ba5 May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:37.974749 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '50777b9e-1315-4cfc-a463-5a6fc3e6f6d3'} May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:37.975544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:37.976735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:37.977899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Returning 404 to user: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:37.977899 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-58236e02-d757-451b-98ef-ec29baf71237 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 404 len: 111 microversion: 2.1 time: 0.029615 May 24 13:41:37.978501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1024/2055] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:41:37 2022] DELETE /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:37.983063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:37.983703 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:37.990269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:37.990805 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:37.991567 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:37.992003 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:38.005437 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] HTTP exception thrown: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Request method failure captured: May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 HTTP/1.1 May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNxWbgojkvVeYfqT7qAAM-63IKyOy4HuVQZHO3TkekbFkRqF4Z24zjaxBuqGxV8t8tOElHAT9A39AejgeB71yIFb-bN_wCaieFZ3ov3_opuWr_AuuR50Kdpbw8WF7BJ-d88iA06iZabGRwDSbBj-0N_G80A7xL4b8y33glGNhNaYVLc May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:41:38.007489 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: e13a5203bc06439ba86befd2eb849ba5 May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:38.008841 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '50777b9e-1315-4cfc-a463-5a6fc3e6f6d3'} May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:38.009761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. May 24 13:41:38.011699 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:38.013173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Returning 404 to user: Instance 50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:38.013173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bc278ffd-8bda-4d2f-846f-5fbba068ed1c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3" status: 404 len: 111 microversion: 2.1 time: 0.029584 May 24 13:41:38.013173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1032/2056] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:37 2022] GET /compute/v2.1/servers/50777b9e-1315-4cfc-a463-5a6fc3e6f6d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 13:41:39.149842 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:39.153624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:39.159211 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:39.161454 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:39.163028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:39.163470 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:39.182250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] HTTP exception thrown: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Request method failure captured: May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 HTTP/1.1 May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijNxWbgojkvVeYfqT7qAAM-63IKyOy4HuVQZHO3TkekbFkRqF4Z24zjaxBuqGxV8t8tOElHAT9A39AejgeB71yIFb-bN_wCaieFZ3ov3_opuWr_AuuR50Kdpbw8WF7BJ-d88iA06iZabGRwDSbBj-0N_G80A7xL4b8y33glGNhNaYVLc May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:41:39.183888 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: e13a5203bc06439ba86befd2eb849ba5 May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.185073 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'b4ec8d2b-f986-4adc-b95a-579cfe890df5'} May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:39.185816 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.187006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:39.188217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Returning 404 to user: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:39.188217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1d6ef7ee-00c0-41dd-9a1e-f47ba2d0ba05 tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 404 len: 111 microversion: 2.1 time: 0.041460 May 24 13:41:39.188217 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1025/2057] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:41:39 2022] DELETE /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:39.196394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:39.197011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] [instance: b4ec8d2b-f986-4adc-b95a-579cfe890df5] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:41:39.203410 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:39.203864 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:39.204629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:41:39.205065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:41:39.221510 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] HTTP exception thrown: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Request method failure captured: May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 HTTP/1.1 May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijNxWbgojkvVeYfqT7qAAM-63IKyOy4HuVQZHO3TkekbFkRqF4Z24zjaxBuqGxV8t8tOElHAT9A39AejgeB71yIFb-bN_wCaieFZ3ov3_opuWr_AuuR50Kdpbw8WF7BJ-d88iA06iZabGRwDSbBj-0N_G80A7xL4b8y33glGNhNaYVLc May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:41:39.223042 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cb54f85be3994a40a4b52e576b36c6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: cb54f85be3994a40a4b52e576b36c6da May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1640449289 May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: e13a5203bc06439ba86befd2eb849ba5 May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-AttachVolumeNegativeTest-1640449289-project May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.224188 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': 'b4ec8d2b-f986-4adc-b95a-579cfe890df5'} May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:39.225424 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. May 24 13:41:39.226660 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:39.227717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] Returning 404 to user: Instance b4ec8d2b-f986-4adc-b95a-579cfe890df5 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:39.227717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-62a513b5-7d8f-466c-a98f-f997872f048c tempest-AttachVolumeNegativeTest-1640449289 tempest-AttachVolumeNegativeTest-1640449289-project] 10.222.0.45 "GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5" status: 404 len: 111 microversion: 2.1 time: 0.031936 May 24 13:41:39.227717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1033/2058] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:41:39 2022] GET /compute/v2.1/servers/b4ec8d2b-f986-4adc-b95a-579cfe890df5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:43.775250 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b178fb27-308b-451d-9524-cf26cdddc763 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Action: 'create', calling method: .version_select at 0x7f9a66f35790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1230987934"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:41:44.050675 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b178fb27-308b-451d-9524-cf26cdddc763 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.388919 May 24 13:41:44.051305 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1026/2059] 10.222.0.45 () {60 vars in 1154 bytes} [Tue May 24 13:41:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 390 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 13:41:44.061953 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4d5e56b8-7896-49b8-8fe0-a3357ff8f5b6 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6849e8b0>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:44.114146 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4d5e56b8-7896-49b8-8fe0-a3357ff8f5b6 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c" status: 200 len: 345 microversion: 2.1 time: 0.055834 May 24 13:41:44.114743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1034/2060] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:41:44 2022] GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:45.127132 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1a83f01-4025-423a-8b6a-4932b7c3ea86 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b960ca0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:45.174654 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c1a83f01-4025-423a-8b6a-4932b7c3ea86 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c" status: 200 len: 346 microversion: 2.1 time: 0.051642 May 24 13:41:45.175218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1027/2061] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:41:45 2022] GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:45.187137 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5d356c40-0f28-4eae-945d-2461b36f1520 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Action: 'create', calling method: .version_select at 0x7f9a6b931790>, body: {"snapshot": {"volume_id": "18ef1865-0bb5-4a63-b54d-5cac91aa218c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1805785349"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:41:45.327434 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5d356c40-0f28-4eae-945d-2461b36f1520 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.144424 May 24 13:41:45.328108 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1035/2062] 10.222.0.45 () {60 vars in 1161 bytes} [Tue May 24 13:41:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:45.338105 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0740d2ec-fd12-45b6-b1dd-353c8e288ef0 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a671a8280>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:45.369726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0740d2ec-fd12-45b6-b1dd-353c8e288ef0 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.035627 May 24 13:41:45.370365 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1028/2063] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:45 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:45.379906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c4009598-1783-44e4-96d4-b024bd94df4f tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b8e2ee0>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:45.413550 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c4009598-1783-44e4-96d4-b024bd94df4f tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037383 May 24 13:41:45.414215 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1036/2064] 10.222.0.45 () {58 vars in 1139 bytes} [Tue May 24 13:41:45 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:45.424142 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c043ad18-28e9-46ed-907c-86552094a249 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a66ffe820>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:45.453036 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c043ad18-28e9-46ed-907c-86552094a249 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.032664 May 24 13:41:45.453624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1029/2065] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:45 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:46.466134 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-77c59c7c-84e5-4ba2-b386-883313bc9ce1 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b960790>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:46.494220 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-77c59c7c-84e5-4ba2-b386-883313bc9ce1 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.032652 May 24 13:41:46.494873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1037/2066] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:46 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:47.507146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5b3a3249-85f5-44d5-ace8-004749da14b8 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6704e310>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:47.534711 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5b3a3249-85f5-44d5-ace8-004749da14b8 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.032487 May 24 13:41:47.535251 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1030/2067] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:47 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:48.551725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-576d88cc-dbb5-4e17-a75c-25853fdabf4d tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b8e2280>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:48.580205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-576d88cc-dbb5-4e17-a75c-25853fdabf4d tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.032818 May 24 13:41:48.580747 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1038/2068] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:48 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:49.589107 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:41:49.589869 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:41:49.593747 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f9de97f5-35f5-45a4-b81d-2e044e72331a tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6703a040>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:49.624213 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f9de97f5-35f5-45a4-b81d-2e044e72331a tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.036309 May 24 13:41:49.624777 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1031/2069] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:49 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:50.632705 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:41:50.633464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:41:50.637927 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-648e788a-ec51-4a48-ae68-a5b67119fcb9 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b922820>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:50.668202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-648e788a-ec51-4a48-ae68-a5b67119fcb9 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.036186 May 24 13:41:50.668823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1039/2070] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:50 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:41:51.680238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b40fe6b4-d019-4e91-a598-274bdcddec99 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a672b7430>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:51.709365 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b40fe6b4-d019-4e91-a598-274bdcddec99 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.032656 May 24 13:41:51.709904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1032/2071] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:51 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:52.721475 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-429004d1-3f7f-43c9-be5e-5a0fd7fda0fc tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b95a790>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:52.749579 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-429004d1-3f7f-43c9-be5e-5a0fd7fda0fc tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.032291 May 24 13:41:52.750124 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1040/2072] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:52 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:53.761964 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e4c199a3-6104-4e8f-891f-0d9fca1179e7 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6703a8b0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:53.791432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e4c199a3-6104-4e8f-891f-0d9fca1179e7 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 288 microversion: 2.1 time: 0.033907 May 24 13:41:53.791993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1033/2073] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:53 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:53.804021 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-c1e7db50-c44c-4930-a7b1-997360bb4c61 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b931e50>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:53.860390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-c1e7db50-c44c-4930-a7b1-997360bb4c61 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 202 len: 0 microversion: 2.1 time: 0.061579 May 24 13:41:53.860960 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1041/2074] 10.222.0.45 () {58 vars in 1253 bytes} [Tue May 24 13:41:53 2022] DELETE /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:41:53.869082 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-30d34c8a-80ee-430c-a2d9-58a9884a9e15 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b9ae160>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:53.899193 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-30d34c8a-80ee-430c-a2d9-58a9884a9e15 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 200 len: 287 microversion: 2.1 time: 0.033829 May 24 13:41:53.899746 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1034/2075] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:53 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:54.911625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-09bb3f24-4558-4212-806a-b1e06516f4d7 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b97c4c0>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:54.938436 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-09bb3f24-4558-4212-806a-b1e06516f4d7 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] HTTP exception thrown: Snapshot 75b6e6bb-f638-4dc5-a939-2feeccf507ca could not be found. May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-09bb3f24-4558-4212-806a-b1e06516f4d7 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Request method failure captured: May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca HTTP/1.1 May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijOCXPYo6d2N8C1lhCHuRMQt8J0oFWYSns80BmjXTX3RALIwI8f_XmEZkHS7xJJ4ANhWN2-ZYPAF96KPL8dlFT-ZIbkElrbq1ZlBIdska8QGp0QSKM_GJJ0kjRWIcxoDP8CNnin6FwjJlR0aZLORw8TUHUxmuUdJP4HBVCHo9QA93cAQ May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 84bcc47b89c54d2f9d1fe2297c465aff May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:41:54.940610 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 84bcc47b89c54d2f9d1fe2297c465aff May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-VolumesSnapshotsTestJSON-704984212-project May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 25d38f024efe46beaa3455abd5185ded May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-704984212-project May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Snapshot 75b6e6bb-f638-4dc5-a939-2feeccf507ca could not be found. May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '75b6e6bb-f638-4dc5-a939-2feeccf507ca'} May 24 13:41:54.941949 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 75b6e6bb-f638-4dc5-a939-2feeccf507ca could not be found. (HTTP 404) (Request-ID: req-aa1c06fe-7633-4451-a055-5b65cee98137) May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:54.943348 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:41:54.944426 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 75b6e6bb-f638-4dc5-a939-2feeccf507ca could not be found. May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 24 13:41:54.946193 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 75b6e6bb-f638-4dc5-a939-2feeccf507ca could not be found. May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 75b6e6bb-f638-4dc5-a939-2feeccf507ca could not be found. May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-09bb3f24-4558-4212-806a-b1e06516f4d7 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Returning 404 to user: Snapshot 75b6e6bb-f638-4dc5-a939-2feeccf507ca could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:54.947511 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-09bb3f24-4558-4212-806a-b1e06516f4d7 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca" status: 404 len: 111 microversion: 2.1 time: 0.034992 May 24 13:41:54.948415 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1042/2076] 10.222.0.45 () {58 vars in 1250 bytes} [Tue May 24 13:41:54 2022] GET /compute/v2.1/os-snapshots/75b6e6bb-f638-4dc5-a939-2feeccf507ca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:54.951309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a901a9ab-4f72-48f4-8f98-5301adc0b4aa tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a66f35790>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:55.014029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a901a9ab-4f72-48f4-8f98-5301adc0b4aa tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c" status: 202 len: 0 microversion: 2.1 time: 0.067024 May 24 13:41:55.014924 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1035/2077] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 13:41:54 2022] DELETE /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:41:55.023367 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5ce0de50-c1d8-4386-bb6b-62502ea15c15 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b931790>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:55.072955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5ce0de50-c1d8-4386-bb6b-62502ea15c15 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c" status: 200 len: 345 microversion: 2.1 time: 0.053539 May 24 13:41:55.076030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1043/2078] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:41:55 2022] GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:41:56.089039 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b92cc644-e3c3-4d47-bcda-dfc0797f2cdb tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a66f5caf0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:56.120740 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-b92cc644-e3c3-4d47-bcda-dfc0797f2cdb tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] HTTP exception thrown: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b92cc644-e3c3-4d47-bcda-dfc0797f2cdb tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Request method failure captured: May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c HTTP/1.1 May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijOCXPYo6d2N8C1lhCHuRMQt8J0oFWYSns80BmjXTX3RALIwI8f_XmEZkHS7xJJ4ANhWN2-ZYPAF96KPL8dlFT-ZIbkElrbq1ZlBIdska8QGp0QSKM_GJJ0kjRWIcxoDP8CNnin6FwjJlR0aZLORw8TUHUxmuUdJP4HBVCHo9QA93cAQ May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 84bcc47b89c54d2f9d1fe2297c465aff May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:41:56.122774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 84bcc47b89c54d2f9d1fe2297c465aff May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotsTestJSON-704984212-project May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 25d38f024efe46beaa3455abd5185ded May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-704984212-project May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '18ef1865-0bb5-4a63-b54d-5cac91aa218c'} May 24 13:41:56.124062 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. (HTTP 404) (Request-ID: req-152cc9a3-e05b-410f-b8cd-c8f8ad9815c5) May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:56.124835 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:41:56.125774 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 13:41:56.126709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b92cc644-e3c3-4d47-bcda-dfc0797f2cdb tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Returning 404 to user: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b92cc644-e3c3-4d47-bcda-dfc0797f2cdb tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c" status: 404 len: 109 microversion: 2.1 time: 0.039846 May 24 13:41:56.127597 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1036/2079] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:41:56 2022] GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:56.138549 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a384cf6a-ff57-494e-9b3a-334394a266f0 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b95a310>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:56.167394 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-a384cf6a-ff57-494e-9b3a-334394a266f0 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] HTTP exception thrown: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a384cf6a-ff57-494e-9b3a-334394a266f0 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Request method failure captured: May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: DELETE /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c HTTP/1.1 May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijOCXPYo6d2N8C1lhCHuRMQt8J0oFWYSns80BmjXTX3RALIwI8f_XmEZkHS7xJJ4ANhWN2-ZYPAF96KPL8dlFT-ZIbkElrbq1ZlBIdska8QGp0QSKM_GJJ0kjRWIcxoDP8CNnin6FwjJlR0aZLORw8TUHUxmuUdJP4HBVCHo9QA93cAQ May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: 84bcc47b89c54d2f9d1fe2297c465aff May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:41:56.169352 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: 84bcc47b89c54d2f9d1fe2297c465aff May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-VolumesSnapshotsTestJSON-704984212-project May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: 25d38f024efe46beaa3455abd5185ded May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-704984212-project May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '18ef1865-0bb5-4a63-b54d-5cac91aa218c'} May 24 13:41:56.170430 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. (HTTP 404) (Request-ID: req-07c7ac0c-6f19-4bb7-86b3-01cfce9c9e79) May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:56.171178 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:41:56.172155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 13:41:56.173098 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a384cf6a-ff57-494e-9b3a-334394a266f0 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Returning 404 to user: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a384cf6a-ff57-494e-9b3a-334394a266f0 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c" status: 404 len: 109 microversion: 2.1 time: 0.036619 May 24 13:41:56.174005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1044/2080] 10.222.0.45 () {58 vars in 1247 bytes} [Tue May 24 13:41:56 2022] DELETE /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:41:56.180395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-235f73b2-f6df-4515-8824-0238e9dcb3f6 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Calling method '.version_select at 0x7f9a6b960790>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:41:56.207784 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-235f73b2-f6df-4515-8824-0238e9dcb3f6 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] HTTP exception thrown: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-235f73b2-f6df-4515-8824-0238e9dcb3f6 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Request method failure captured: May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c HTTP/1.1 May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijOCXPYo6d2N8C1lhCHuRMQt8J0oFWYSns80BmjXTX3RALIwI8f_XmEZkHS7xJJ4ANhWN2-ZYPAF96KPL8dlFT-ZIbkElrbq1ZlBIdska8QGp0QSKM_GJJ0kjRWIcxoDP8CNnin6FwjJlR0aZLORw8TUHUxmuUdJP4HBVCHo9QA93cAQ May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 84bcc47b89c54d2f9d1fe2297c465aff May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:41:56.209692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/84bcc47b89c54d2f9d1fe2297c465aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 84bcc47b89c54d2f9d1fe2297c465aff May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-704984212 May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotsTestJSON-704984212-project May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 25d38f024efe46beaa3455abd5185ded May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-704984212-project May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '18ef1865-0bb5-4a63-b54d-5cac91aa218c'} May 24 13:41:56.211154 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. (HTTP 404) (Request-ID: req-dad60bb3-15c7-4500-b5c7-f29221f0ce06) May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:56.211931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:41:56.213329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 13:41:56.214411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-235f73b2-f6df-4515-8824-0238e9dcb3f6 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] Returning 404 to user: Volume 18ef1865-0bb5-4a63-b54d-5cac91aa218c could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-235f73b2-f6df-4515-8824-0238e9dcb3f6 tempest-VolumesSnapshotsTestJSON-704984212 tempest-VolumesSnapshotsTestJSON-704984212-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c" status: 404 len: 109 microversion: 2.1 time: 0.035106 May 24 13:41:56.216931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1037/2081] 10.222.0.45 () {58 vars in 1244 bytes} [Tue May 24 13:41:56 2022] GET /compute/v2.1/os-volumes/18ef1865-0bb5-4a63-b54d-5cac91aa218c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:42:00.045879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:42:00.046465 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:42:23.500158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1225802542", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "networks": [{"uuid": "7e877a32-9cb7-4c7c-b47b-d76bb4d0d1e3"}]}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:42:23.550726 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.network.neutron [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] validate_networks() for [('7e877a32-9cb7-4c7c-b47b-d76bb4d0d1e3', None, None, None, None, None)] {{(pid=117643) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:42:23.941084 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Flavor limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:42:23.941516 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Image limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:42:23.941998 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Flavor pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:42:23.943043 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Image pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:42:23.943432 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:42:23.952601 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:23.953052 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:23.953850 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:23.954305 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:23.971455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Getting quotas for project 7ae76df6ad404589b0b16ba43d844c48. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:42:23.975481 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Getting quotas for user 18a4a93a0cef4b1299b6c520639fed61 and project 7ae76df6ad404589b0b16ba43d844c48. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:42:23.986302 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Going to run 1 instances... {{(pid=117643) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:42:23.988548 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:42:24.034659 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-16ca9324-9617-46f9-a0fb-872394db7508 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539034 May 24 13:42:24.035292 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1045/2082] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:42:24.045948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5415cffe-176c-48cb-b5f7-4f576adf252a tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:24.046652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5415cffe-176c-48cb-b5f7-4f576adf252a tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:24.099552 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5415cffe-176c-48cb-b5f7-4f576adf252a tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:24.107400 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5415cffe-176c-48cb-b5f7-4f576adf252a tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1219 microversion: 2.1 time: 0.065907 May 24 13:42:24.107970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1038/2083] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:24 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:42:25.124632 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-73d6c969-a1dc-468b-a967-854f7f46ae09 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:25.125306 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-73d6c969-a1dc-468b-a967-854f7f46ae09 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:25.132757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73d6c969-a1dc-468b-a967-854f7f46ae09 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:25.132757 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73d6c969-a1dc-468b-a967-854f7f46ae09 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:25.133528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73d6c969-a1dc-468b-a967-854f7f46ae09 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:25.134570 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-73d6c969-a1dc-468b-a967-854f7f46ae09 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:25.210668 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-73d6c969-a1dc-468b-a967-854f7f46ae09 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:25.220136 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-73d6c969-a1dc-468b-a967-854f7f46ae09 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1277 microversion: 2.1 time: 0.099399 May 24 13:42:25.220914 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1046/2084] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:25 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:42:26.238738 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2223a567-6d21-4bc9-81f7-3ca66b6b92e2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:26.240009 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2223a567-6d21-4bc9-81f7-3ca66b6b92e2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:26.246069 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2223a567-6d21-4bc9-81f7-3ca66b6b92e2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:26.246539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2223a567-6d21-4bc9-81f7-3ca66b6b92e2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:26.247320 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2223a567-6d21-4bc9-81f7-3ca66b6b92e2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:26.247762 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2223a567-6d21-4bc9-81f7-3ca66b6b92e2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:26.439737 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2223a567-6d21-4bc9-81f7-3ca66b6b92e2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:26.448984 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2223a567-6d21-4bc9-81f7-3ca66b6b92e2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1319 microversion: 2.1 time: 0.215296 May 24 13:42:26.449795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1039/2085] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:26 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:42:26.562962 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-bed743b0-5e84-4291-8203-40506564d309 req-764d9ec1-e292-4582-89d8-6299a93f8eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2982444f-4659-43e2-8347-40e60dc09c7f", "tag": "19e46340-8127-4561-b7f5-7bb86f5ad2ce"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:42:26.573213 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-bed743b0-5e84-4291-8203-40506564d309 req-764d9ec1-e292-4582-89d8-6299a93f8eb5 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:26.573919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-bed743b0-5e84-4291-8203-40506564d309 req-764d9ec1-e292-4582-89d8-6299a93f8eb5 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:26.589331 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-bed743b0-5e84-4291-8203-40506564d309 req-764d9ec1-e292-4582-89d8-6299a93f8eb5 service nova] Creating event network-changed:19e46340-8127-4561-b7f5-7bb86f5ad2ce for instance 2982444f-4659-43e2-8347-40e60dc09c7f on hv-cinder-84301 May 24 13:42:26.595680 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-bed743b0-5e84-4291-8203-40506564d309 req-764d9ec1-e292-4582-89d8-6299a93f8eb5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038392 May 24 13:42:26.596677 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1047/2086] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:42:27.466906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-deae6a20-480f-47d3-af6a-dd56b639f029 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:27.467515 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-deae6a20-480f-47d3-af6a-dd56b639f029 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:27.473982 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-deae6a20-480f-47d3-af6a-dd56b639f029 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:27.474459 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-deae6a20-480f-47d3-af6a-dd56b639f029 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:27.475209 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-deae6a20-480f-47d3-af6a-dd56b639f029 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:27.475639 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-deae6a20-480f-47d3-af6a-dd56b639f029 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:27.600488 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-deae6a20-480f-47d3-af6a-dd56b639f029 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:27.607906 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-deae6a20-480f-47d3-af6a-dd56b639f029 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1319 microversion: 2.1 time: 0.145483 May 24 13:42:27.608478 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1040/2087] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:27 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:42:28.626028 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ad4afb79-562a-4567-8579-be181cb0b7ca tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:28.626759 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ad4afb79-562a-4567-8579-be181cb0b7ca tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:28.633791 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad4afb79-562a-4567-8579-be181cb0b7ca tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:28.634237 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad4afb79-562a-4567-8579-be181cb0b7ca tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:28.635046 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad4afb79-562a-4567-8579-be181cb0b7ca tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:28.635482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ad4afb79-562a-4567-8579-be181cb0b7ca tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:28.760383 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ad4afb79-562a-4567-8579-be181cb0b7ca tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:28.768121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ad4afb79-562a-4567-8579-be181cb0b7ca tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1319 microversion: 2.1 time: 0.146760 May 24 13:42:28.768685 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1048/2088] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:28 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:42:29.784719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f091890a-e09a-4ab6-9367-65e30dc675d8 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:29.785248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f091890a-e09a-4ab6-9367-65e30dc675d8 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:29.791796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f091890a-e09a-4ab6-9367-65e30dc675d8 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:29.792242 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f091890a-e09a-4ab6-9367-65e30dc675d8 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:29.793002 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f091890a-e09a-4ab6-9367-65e30dc675d8 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:29.793439 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f091890a-e09a-4ab6-9367-65e30dc675d8 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:29.919505 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f091890a-e09a-4ab6-9367-65e30dc675d8 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:29.927480 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f091890a-e09a-4ab6-9367-65e30dc675d8 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1319 microversion: 2.1 time: 0.146066 May 24 13:42:29.928043 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1041/2089] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:29 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:42:30.944583 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-adfd1a48-f86b-43d3-838d-346e5f2aef31 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:30.945260 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-adfd1a48-f86b-43d3-838d-346e5f2aef31 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:30.951695 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adfd1a48-f86b-43d3-838d-346e5f2aef31 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:30.952142 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adfd1a48-f86b-43d3-838d-346e5f2aef31 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:30.952898 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adfd1a48-f86b-43d3-838d-346e5f2aef31 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:30.953336 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-adfd1a48-f86b-43d3-838d-346e5f2aef31 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:31.079719 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-adfd1a48-f86b-43d3-838d-346e5f2aef31 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:31.088173 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-adfd1a48-f86b-43d3-838d-346e5f2aef31 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1319 microversion: 2.1 time: 0.147981 May 24 13:42:31.088740 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1049/2090] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:30 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:42:32.104631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-96fc3c59-9016-4809-aa80-dd931194fade tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:32.105243 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-96fc3c59-9016-4809-aa80-dd931194fade tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:32.111818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96fc3c59-9016-4809-aa80-dd931194fade tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:32.112270 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96fc3c59-9016-4809-aa80-dd931194fade tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:32.113031 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96fc3c59-9016-4809-aa80-dd931194fade tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:32.113464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96fc3c59-9016-4809-aa80-dd931194fade tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:32.167271 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-09090145-775c-4383-8ade-e55cde1b8d13 req-a672014f-1cd3-4edb-959a-8238ee2d8ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2982444f-4659-43e2-8347-40e60dc09c7f", "name": "network-vif-plugged", "status": "completed", "tag": "19e46340-8127-4561-b7f5-7bb86f5ad2ce"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:42:32.178218 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-09090145-775c-4383-8ade-e55cde1b8d13 req-a672014f-1cd3-4edb-959a-8238ee2d8ec5 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:32.178696 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-09090145-775c-4383-8ade-e55cde1b8d13 req-a672014f-1cd3-4edb-959a-8238ee2d8ec5 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:32.189887 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-09090145-775c-4383-8ade-e55cde1b8d13 req-a672014f-1cd3-4edb-959a-8238ee2d8ec5 service nova] Creating event network-vif-plugged:19e46340-8127-4561-b7f5-7bb86f5ad2ce for instance 2982444f-4659-43e2-8347-40e60dc09c7f on hv-cinder-84301 May 24 13:42:32.195527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-09090145-775c-4383-8ade-e55cde1b8d13 req-a672014f-1cd3-4edb-959a-8238ee2d8ec5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032185 May 24 13:42:32.196205 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1050/2091] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:42:32.262343 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-96fc3c59-9016-4809-aa80-dd931194fade tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:32.269874 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-96fc3c59-9016-4809-aa80-dd931194fade tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1319 microversion: 2.1 time: 0.169112 May 24 13:42:32.271053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1042/2092] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:32 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:42:33.288068 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a8a42aab-7f06-44ee-a53a-b33ed77c2d4c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:33.288800 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a8a42aab-7f06-44ee-a53a-b33ed77c2d4c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:33.295108 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8a42aab-7f06-44ee-a53a-b33ed77c2d4c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:33.295560 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8a42aab-7f06-44ee-a53a-b33ed77c2d4c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:33.296314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8a42aab-7f06-44ee-a53a-b33ed77c2d4c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:33.296758 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a8a42aab-7f06-44ee-a53a-b33ed77c2d4c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:33.422915 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a8a42aab-7f06-44ee-a53a-b33ed77c2d4c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:33.431269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a8a42aab-7f06-44ee-a53a-b33ed77c2d4c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1319 microversion: 2.1 time: 0.147844 May 24 13:42:33.431835 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1051/2093] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:33 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:42:34.448463 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e9fa78ea-97e8-4e32-affa-50833c87a13d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:42:34.449074 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e9fa78ea-97e8-4e32-affa-50833c87a13d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:34.451525 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:42:34.456938 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9fa78ea-97e8-4e32-affa-50833c87a13d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:34.457541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9fa78ea-97e8-4e32-affa-50833c87a13d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:34.459005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9fa78ea-97e8-4e32-affa-50833c87a13d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:34.459471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e9fa78ea-97e8-4e32-affa-50833c87a13d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:34.583612 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e9fa78ea-97e8-4e32-affa-50833c87a13d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:42:34.591273 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e9fa78ea-97e8-4e32-affa-50833c87a13d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1508 microversion: 2.1 time: 0.146713 May 24 13:42:34.591838 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1043/2094] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:42:34 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:42:59.159023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-5be1d38c-1b38-432f-bec2-b3136f6954a6 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b03721f6-387c-404e-b1d9-517f948d874d", "device": "/dev/sdb"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:42:59.160646 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-5be1d38c-1b38-432f-bec2-b3136f6954a6 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:42:59.162904 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:42:59.163629 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=6 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:42:59.164396 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:42:59.165138 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=30 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:42:59.171971 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5be1d38c-1b38-432f-bec2-b3136f6954a6 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:59.172420 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5be1d38c-1b38-432f-bec2-b3136f6954a6 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:59.173175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5be1d38c-1b38-432f-bec2-b3136f6954a6 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:42:59.173609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-5be1d38c-1b38-432f-bec2-b3136f6954a6 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:42:59.410687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-5be1d38c-1b38-432f-bec2-b3136f6954a6 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "POST /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255347 May 24 13:42:59.411299 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1052/2095] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 13:42:59 2022] POST /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:43:26.080450 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a64b3d2d-b75d-4f8e-8219-8f1da4c053af tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:26.080979 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a64b3d2d-b75d-4f8e-8219-8f1da4c053af tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:26.082953 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=14 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:26.083641 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:26.089804 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a64b3d2d-b75d-4f8e-8219-8f1da4c053af tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:26.090233 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a64b3d2d-b75d-4f8e-8219-8f1da4c053af tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:26.091026 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a64b3d2d-b75d-4f8e-8219-8f1da4c053af tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:26.091461 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a64b3d2d-b75d-4f8e-8219-8f1da4c053af tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:26.170468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-a64b3d2d-b75d-4f8e-8219-8f1da4c053af tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lazy-loading 'services' on Instance uuid 2982444f-4659-43e2-8347-40e60dc09c7f {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:43:26.241771 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a64b3d2d-b75d-4f8e-8219-8f1da4c053af tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f/os-volume_attachments/b03721f6-387c-404e-b1d9-517f948d874d" status: 202 len: 0 microversion: 2.1 time: 0.166819 May 24 13:43:26.242365 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1044/2096] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 13:43:26 2022] DELETE /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f/os-volume_attachments/b03721f6-387c-404e-b1d9-517f948d874d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:43:27.362422 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:27.363183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:27.367848 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ef98a5c9-a37d-4833-8ba2-4565c7366283 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:27.368437 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ef98a5c9-a37d-4833-8ba2-4565c7366283 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:27.376592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ef98a5c9-a37d-4833-8ba2-4565c7366283 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:27.377045 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ef98a5c9-a37d-4833-8ba2-4565c7366283 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:27.377812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ef98a5c9-a37d-4833-8ba2-4565c7366283 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:27.378252 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ef98a5c9-a37d-4833-8ba2-4565c7366283 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:27.404796 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ef98a5c9-a37d-4833-8ba2-4565c7366283 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Going to try to terminate instance {{(pid=117643) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:43:27.478504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ef98a5c9-a37d-4833-8ba2-4565c7366283 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 204 len: 0 microversion: 2.1 time: 0.116977 May 24 13:43:27.479339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1053/2097] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:43:27 2022] DELETE /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:43:27.487817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3337cbba-f9b0-4af3-959d-7e6b66a6260e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:27.488501 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3337cbba-f9b0-4af3-959d-7e6b66a6260e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:27.495712 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3337cbba-f9b0-4af3-959d-7e6b66a6260e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:27.496156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3337cbba-f9b0-4af3-959d-7e6b66a6260e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:27.496908 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3337cbba-f9b0-4af3-959d-7e6b66a6260e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:27.497339 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3337cbba-f9b0-4af3-959d-7e6b66a6260e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:27.628420 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3337cbba-f9b0-4af3-959d-7e6b66a6260e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:27.636575 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3337cbba-f9b0-4af3-959d-7e6b66a6260e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1514 microversion: 2.1 time: 0.152961 May 24 13:43:27.637137 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1045/2098] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:27 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:43:28.653710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-eb7edc02-5ead-4010-87d0-d4b8d90bf25b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:28.654609 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-eb7edc02-5ead-4010-87d0-d4b8d90bf25b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:28.661206 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb7edc02-5ead-4010-87d0-d4b8d90bf25b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:28.661597 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb7edc02-5ead-4010-87d0-d4b8d90bf25b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:28.662390 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb7edc02-5ead-4010-87d0-d4b8d90bf25b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:28.662830 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-eb7edc02-5ead-4010-87d0-d4b8d90bf25b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:28.790197 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-eb7edc02-5ead-4010-87d0-d4b8d90bf25b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:28.798268 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-eb7edc02-5ead-4010-87d0-d4b8d90bf25b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1514 microversion: 2.1 time: 0.148786 May 24 13:43:28.798859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1054/2099] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:28 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:29.764864 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-2b2e3b83-ff37-4a80-8f2a-5d7cf759fc80 req-8c6bb0ac-fe63-42c2-a48c-092c2c216afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2982444f-4659-43e2-8347-40e60dc09c7f", "name": "network-vif-deleted", "tag": "19e46340-8127-4561-b7f5-7bb86f5ad2ce"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:43:29.773596 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2b2e3b83-ff37-4a80-8f2a-5d7cf759fc80 req-8c6bb0ac-fe63-42c2-a48c-092c2c216afd service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:29.774038 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2b2e3b83-ff37-4a80-8f2a-5d7cf759fc80 req-8c6bb0ac-fe63-42c2-a48c-092c2c216afd service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:29.785106 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-2b2e3b83-ff37-4a80-8f2a-5d7cf759fc80 req-8c6bb0ac-fe63-42c2-a48c-092c2c216afd service nova] Creating event network-vif-deleted:19e46340-8127-4561-b7f5-7bb86f5ad2ce for instance 2982444f-4659-43e2-8347-40e60dc09c7f on hv-cinder-84301 May 24 13:43:29.790512 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-2b2e3b83-ff37-4a80-8f2a-5d7cf759fc80 req-8c6bb0ac-fe63-42c2-a48c-092c2c216afd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029081 May 24 13:43:29.791053 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1046/2100] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:43:29.815725 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-132d1792-cfdb-4c17-90a6-b5591ebaabba tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:29.816344 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-132d1792-cfdb-4c17-90a6-b5591ebaabba tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:29.823649 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-132d1792-cfdb-4c17-90a6-b5591ebaabba tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:29.824105 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-132d1792-cfdb-4c17-90a6-b5591ebaabba tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:29.824874 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-132d1792-cfdb-4c17-90a6-b5591ebaabba tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:29.825533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-132d1792-cfdb-4c17-90a6-b5591ebaabba tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:29.890414 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-132d1792-cfdb-4c17-90a6-b5591ebaabba tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:29.898030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-132d1792-cfdb-4c17-90a6-b5591ebaabba tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 200 len: 1304 microversion: 2.1 time: 0.086218 May 24 13:43:29.898635 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1055/2101] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:29 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:30.925669 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:30.926407 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: 2982444f-4659-43e2-8347-40e60dc09c7f] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:30.932637 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:30.933093 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:30.933865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:30.934329 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:30.947829 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] HTTP exception thrown: Instance 2982444f-4659-43e2-8347-40e60dc09c7f could not be found. May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Request method failure captured: May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f HTTP/1.1 May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijOC-AYWbI8229DWox0xxR74RAVt7agWRIdG1yY4BNVxYQhObDpbQFFSQfLtZB4dHRK6Q-KajmezFf55A8M3l92XblBDaiZcYrUFdy6PpUAuodPakLHk3CCscKYquqhF3jdhFALt-G8oVL-mzl2GM97gO_o-rb9gYhXR8nTBN1C3ScrA May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 7ae76df6ad404589b0b16ba43d844c48 May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotTestJSON-936727377 May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:43:30.949417 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7ae76df6ad404589b0b16ba43d844c48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7ae76df6ad404589b0b16ba43d844c48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7ae76df6ad404589b0b16ba43d844c48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7ae76df6ad404589b0b16ba43d844c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotTestJSON-936727377 May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 7ae76df6ad404589b0b16ba43d844c48 May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-936727377 May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotTestJSON-936727377-project May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 18a4a93a0cef4b1299b6c520639fed61 May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotTestJSON-936727377-project May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance 2982444f-4659-43e2-8347-40e60dc09c7f could not be found. May 24 13:43:30.950770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': '2982444f-4659-43e2-8347-40e60dc09c7f'} May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2982444f-4659-43e2-8347-40e60dc09c7f could not be found. May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:43:30.951468 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2982444f-4659-43e2-8347-40e60dc09c7f could not be found. May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2982444f-4659-43e2-8347-40e60dc09c7f could not be found. May 24 13:43:30.952595 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:43:30.953529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Returning 404 to user: Instance 2982444f-4659-43e2-8347-40e60dc09c7f could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:43:30.953529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f320658c-0763-497f-81bc-882bb932607b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f" status: 404 len: 111 microversion: 2.1 time: 0.029939 May 24 13:43:30.953529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1047/2102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:30 2022] GET /compute/v2.1/servers/2982444f-4659-43e2-8347-40e60dc09c7f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:43:42.862374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-279107107", "imageRef": "95d5f774-d33b-45a6-a54f-2402743506bf", "flavorRef": "452", "networks": [{"uuid": "7e877a32-9cb7-4c7c-b47b-d76bb4d0d1e3"}]}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:43:42.871675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:42.872514 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:42.919361 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.network.neutron [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] validate_networks() for [('7e877a32-9cb7-4c7c-b47b-d76bb4d0d1e3', None, None, None, None, None)] {{(pid=117643) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:43:43.257918 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Flavor limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:43:43.258375 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Image limits 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:43:43.258849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Flavor pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:43:43.259258 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Image pref 0:0:0 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:43:43.260016 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.virt.hardware [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:43:43.268622 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:43.269064 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:43.269844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:43.270275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:43.454991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Getting quotas for project 7ae76df6ad404589b0b16ba43d844c48. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:43:43.459217 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Getting quotas for user 18a4a93a0cef4b1299b6c520639fed61 and project 7ae76df6ad404589b0b16ba43d844c48. Resources: {'cores', 'ram', 'instances'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:43:43.471608 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Going to run 1 instances... {{(pid=117643) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:43:43.473859 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95d5f774-d33b-45a6-a54f-2402743506bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:43:43.518161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1f7e82c6-cf4a-4f72-83a3-abf597ebdbee tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660642 May 24 13:43:43.518856 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1056/2103] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:43:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 13:43:43.529244 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b962f2cf-1a43-45c8-b261-f27b466f0f0d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:43.529864 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b962f2cf-1a43-45c8-b261-f27b466f0f0d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:43.532427 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=8 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:43.533071 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:43.586238 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b962f2cf-1a43-45c8-b261-f27b466f0f0d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:43.594094 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b962f2cf-1a43-45c8-b261-f27b466f0f0d tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1218 microversion: 2.1 time: 0.069352 May 24 13:43:43.594719 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1048/2104] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:43 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:44.611597 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6db2bf76-14b0-426e-ab69-5a1f823eef93 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:44.612212 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6db2bf76-14b0-426e-ab69-5a1f823eef93 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:44.618647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6db2bf76-14b0-426e-ab69-5a1f823eef93 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:44.619607 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6db2bf76-14b0-426e-ab69-5a1f823eef93 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:44.620358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6db2bf76-14b0-426e-ab69-5a1f823eef93 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:44.620789 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6db2bf76-14b0-426e-ab69-5a1f823eef93 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:44.723670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-6db2bf76-14b0-426e-ab69-5a1f823eef93 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:44.731551 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6db2bf76-14b0-426e-ab69-5a1f823eef93 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1270 microversion: 2.1 time: 0.124322 May 24 13:43:44.735612 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1057/2105] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:44 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:45.747930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3c0e6953-f60a-4c02-a56c-e24592f6ff21 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:45.748556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c0e6953-f60a-4c02-a56c-e24592f6ff21 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:45.756170 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0e6953-f60a-4c02-a56c-e24592f6ff21 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:45.756622 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0e6953-f60a-4c02-a56c-e24592f6ff21 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:45.757456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0e6953-f60a-4c02-a56c-e24592f6ff21 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:45.757904 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0e6953-f60a-4c02-a56c-e24592f6ff21 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:45.886186 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3c0e6953-f60a-4c02-a56c-e24592f6ff21 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:45.893756 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3c0e6953-f60a-4c02-a56c-e24592f6ff21 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1318 microversion: 2.1 time: 0.149783 May 24 13:43:45.894550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1049/2106] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:45 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:46.218670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-03190c97-a9d0-499c-a349-4aeb6b692c5f req-60d66dd8-df9c-4b27-bc21-27ba8dc84554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be6971dd-8ce4-4f35-96f2-1defeea1c81d", "tag": "1b4f36aa-d350-4bfa-a2d4-ffe83bf9a3d4"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:43:46.228195 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-03190c97-a9d0-499c-a349-4aeb6b692c5f req-60d66dd8-df9c-4b27-bc21-27ba8dc84554 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:46.229599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-03190c97-a9d0-499c-a349-4aeb6b692c5f req-60d66dd8-df9c-4b27-bc21-27ba8dc84554 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:46.241755 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-03190c97-a9d0-499c-a349-4aeb6b692c5f req-60d66dd8-df9c-4b27-bc21-27ba8dc84554 service nova] Creating event network-changed:1b4f36aa-d350-4bfa-a2d4-ffe83bf9a3d4 for instance be6971dd-8ce4-4f35-96f2-1defeea1c81d on hv-cinder-84301 May 24 13:43:46.246599 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-03190c97-a9d0-499c-a349-4aeb6b692c5f req-60d66dd8-df9c-4b27-bc21-27ba8dc84554 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031843 May 24 13:43:46.247186 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1058/2107] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:43:46.911199 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-19c98e35-0065-4104-9e13-6f3f1cd5723f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:46.911820 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-19c98e35-0065-4104-9e13-6f3f1cd5723f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:46.918988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c98e35-0065-4104-9e13-6f3f1cd5723f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:46.919447 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c98e35-0065-4104-9e13-6f3f1cd5723f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:46.920212 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c98e35-0065-4104-9e13-6f3f1cd5723f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:46.920652 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c98e35-0065-4104-9e13-6f3f1cd5723f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:47.049976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-19c98e35-0065-4104-9e13-6f3f1cd5723f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:47.057481 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-19c98e35-0065-4104-9e13-6f3f1cd5723f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1318 microversion: 2.1 time: 0.150246 May 24 13:43:47.058040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1050/2108] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:46 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:48.079044 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-4b91ffad-2592-4dae-a1ee-b73ef993c845 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:48.079773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-4b91ffad-2592-4dae-a1ee-b73ef993c845 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:48.086329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4b91ffad-2592-4dae-a1ee-b73ef993c845 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:48.086793 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4b91ffad-2592-4dae-a1ee-b73ef993c845 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:48.087559 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4b91ffad-2592-4dae-a1ee-b73ef993c845 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:48.088906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-4b91ffad-2592-4dae-a1ee-b73ef993c845 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:48.216030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-4b91ffad-2592-4dae-a1ee-b73ef993c845 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:48.223382 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-4b91ffad-2592-4dae-a1ee-b73ef993c845 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1318 microversion: 2.1 time: 0.153195 May 24 13:43:48.223963 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1059/2109] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:48 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:49.240213 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1990c347-0ea1-4345-8fe7-dfa7bec2f8ec tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:49.240820 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1990c347-0ea1-4345-8fe7-dfa7bec2f8ec tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:49.247288 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1990c347-0ea1-4345-8fe7-dfa7bec2f8ec tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:49.247735 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1990c347-0ea1-4345-8fe7-dfa7bec2f8ec tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:49.248623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1990c347-0ea1-4345-8fe7-dfa7bec2f8ec tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:49.249059 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1990c347-0ea1-4345-8fe7-dfa7bec2f8ec tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:49.372601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1990c347-0ea1-4345-8fe7-dfa7bec2f8ec tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:49.379909 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1990c347-0ea1-4345-8fe7-dfa7bec2f8ec tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1318 microversion: 2.1 time: 0.143564 May 24 13:43:49.380460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1051/2110] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:49 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:50.396617 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-bc9df6ea-0411-48e0-b84a-54da621272c0 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:50.397244 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-bc9df6ea-0411-48e0-b84a-54da621272c0 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:50.403876 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc9df6ea-0411-48e0-b84a-54da621272c0 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:50.404328 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc9df6ea-0411-48e0-b84a-54da621272c0 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:50.405103 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc9df6ea-0411-48e0-b84a-54da621272c0 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:50.405545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-bc9df6ea-0411-48e0-b84a-54da621272c0 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:50.533892 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-bc9df6ea-0411-48e0-b84a-54da621272c0 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:50.541877 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-bc9df6ea-0411-48e0-b84a-54da621272c0 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1318 microversion: 2.1 time: 0.149088 May 24 13:43:50.542538 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1060/2111] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:50 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:51.559249 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a278334f-4cae-4656-aac5-91bc18e93cfd tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:51.559847 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a278334f-4cae-4656-aac5-91bc18e93cfd tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:51.567471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a278334f-4cae-4656-aac5-91bc18e93cfd tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:51.568271 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a278334f-4cae-4656-aac5-91bc18e93cfd tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:51.569624 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a278334f-4cae-4656-aac5-91bc18e93cfd tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:51.570532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a278334f-4cae-4656-aac5-91bc18e93cfd tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:51.712258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a278334f-4cae-4656-aac5-91bc18e93cfd tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:51.720440 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a278334f-4cae-4656-aac5-91bc18e93cfd tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1318 microversion: 2.1 time: 0.165597 May 24 13:43:51.721006 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1052/2112] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:51 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:52.631077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-376154cd-cccd-44e1-939f-f6def4a48a3f req-606a4089-012e-4dc5-a2b9-0a2e4d91338d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6971dd-8ce4-4f35-96f2-1defeea1c81d", "name": "network-vif-plugged", "status": "completed", "tag": "1b4f36aa-d350-4bfa-a2d4-ffe83bf9a3d4"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:43:52.639945 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-376154cd-cccd-44e1-939f-f6def4a48a3f req-606a4089-012e-4dc5-a2b9-0a2e4d91338d service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:52.640191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-376154cd-cccd-44e1-939f-f6def4a48a3f req-606a4089-012e-4dc5-a2b9-0a2e4d91338d service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:52.651130 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-376154cd-cccd-44e1-939f-f6def4a48a3f req-606a4089-012e-4dc5-a2b9-0a2e4d91338d service nova] Creating event network-vif-plugged:1b4f36aa-d350-4bfa-a2d4-ffe83bf9a3d4 for instance be6971dd-8ce4-4f35-96f2-1defeea1c81d on hv-cinder-84301 May 24 13:43:52.656080 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-376154cd-cccd-44e1-939f-f6def4a48a3f req-606a4089-012e-4dc5-a2b9-0a2e4d91338d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028582 May 24 13:43:52.656604 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1061/2113] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:43:52.740221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-296f113e-f0f5-4218-9160-fe04b7c55f5e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:52.740951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-296f113e-f0f5-4218-9160-fe04b7c55f5e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:52.748328 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-296f113e-f0f5-4218-9160-fe04b7c55f5e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:52.748775 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-296f113e-f0f5-4218-9160-fe04b7c55f5e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:52.749530 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-296f113e-f0f5-4218-9160-fe04b7c55f5e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:52.749960 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-296f113e-f0f5-4218-9160-fe04b7c55f5e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:52.879507 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-296f113e-f0f5-4218-9160-fe04b7c55f5e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:52.886975 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-296f113e-f0f5-4218-9160-fe04b7c55f5e tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1318 microversion: 2.1 time: 0.150738 May 24 13:43:52.887541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1053/2114] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:52 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:53.900761 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:53.901523 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=6 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:53.905988 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-62278647-7aa5-4877-b7b9-551434b7e87f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:53.906728 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-62278647-7aa5-4877-b7b9-551434b7e87f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:53.913743 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62278647-7aa5-4877-b7b9-551434b7e87f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:53.914187 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62278647-7aa5-4877-b7b9-551434b7e87f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:53.914965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62278647-7aa5-4877-b7b9-551434b7e87f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:53.915401 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-62278647-7aa5-4877-b7b9-551434b7e87f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:54.042873 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-62278647-7aa5-4877-b7b9-551434b7e87f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:54.050138 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-62278647-7aa5-4877-b7b9-551434b7e87f tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1318 microversion: 2.1 time: 0.150337 May 24 13:43:54.050717 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1062/2115] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:53 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:55.066927 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2005e84d-63c5-4682-b248-bf6cad754702 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:43:55.067539 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2005e84d-63c5-4682-b248-bf6cad754702 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:55.069411 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:43:55.075891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2005e84d-63c5-4682-b248-bf6cad754702 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:55.076334 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2005e84d-63c5-4682-b248-bf6cad754702 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:55.077114 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2005e84d-63c5-4682-b248-bf6cad754702 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:55.077543 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2005e84d-63c5-4682-b248-bf6cad754702 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:55.200770 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2005e84d-63c5-4682-b248-bf6cad754702 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:43:55.208095 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2005e84d-63c5-4682-b248-bf6cad754702 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1507 microversion: 2.1 time: 0.144977 May 24 13:43:55.208649 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1054/2116] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:43:55 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:43:55.224986 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-d30cd286-46ea-4827-8e80-9012b18b6e65 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "190bf550-cf28-4478-99ef-1610fc738706", "device": "/dev/sdb"}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:43:55.226101 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-d30cd286-46ea-4827-8e80-9012b18b6e65 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:43:55.233267 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d30cd286-46ea-4827-8e80-9012b18b6e65 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:55.233724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d30cd286-46ea-4827-8e80-9012b18b6e65 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:55.234525 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d30cd286-46ea-4827-8e80-9012b18b6e65 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:43:55.234972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-d30cd286-46ea-4827-8e80-9012b18b6e65 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:43:55.467493 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-d30cd286-46ea-4827-8e80-9012b18b6e65 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "POST /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246351 May 24 13:43:55.468111 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1063/2117] 10.222.0.45 () {60 vars in 1322 bytes} [Tue May 24 13:43:55 2022] POST /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:44:17.823395 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4e0cfb6d-6836-4b4d-a4aa-f5cd0987c7f2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:44:17.823919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4e0cfb6d-6836-4b4d-a4aa-f5cd0987c7f2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:44:17.825879 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=16 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:44:17.826623 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=36 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:44:17.832256 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e0cfb6d-6836-4b4d-a4aa-f5cd0987c7f2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:17.832705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e0cfb6d-6836-4b4d-a4aa-f5cd0987c7f2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:17.833477 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e0cfb6d-6836-4b4d-a4aa-f5cd0987c7f2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:17.833914 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e0cfb6d-6836-4b4d-a4aa-f5cd0987c7f2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:17.913783 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-4e0cfb6d-6836-4b4d-a4aa-f5cd0987c7f2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lazy-loading 'services' on Instance uuid be6971dd-8ce4-4f35-96f2-1defeea1c81d {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:44:17.984190 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4e0cfb6d-6836-4b4d-a4aa-f5cd0987c7f2 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "DELETE /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d/os-volume_attachments/190bf550-cf28-4478-99ef-1610fc738706" status: 202 len: 0 microversion: 2.1 time: 0.165231 May 24 13:44:17.984850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1055/2118] 10.222.0.45 () {58 vars in 1415 bytes} [Tue May 24 13:44:17 2022] DELETE /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d/os-volume_attachments/190bf550-cf28-4478-99ef-1610fc738706 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:44:19.091813 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:44:19.092572 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:44:19.096724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-6558d156-c732-48c8-a292-54bfdee9514c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:44:19.097304 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6558d156-c732-48c8-a292-54bfdee9514c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:44:19.104875 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6558d156-c732-48c8-a292-54bfdee9514c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:19.105316 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6558d156-c732-48c8-a292-54bfdee9514c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:19.106077 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6558d156-c732-48c8-a292-54bfdee9514c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:19.106538 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-6558d156-c732-48c8-a292-54bfdee9514c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:19.132689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-6558d156-c732-48c8-a292-54bfdee9514c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Going to try to terminate instance {{(pid=117643) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:44:19.206423 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-6558d156-c732-48c8-a292-54bfdee9514c tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "DELETE /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 204 len: 0 microversion: 2.1 time: 0.115867 May 24 13:44:19.206955 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1064/2119] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:44:19 2022] DELETE /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:44:19.215850 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bf1d4ac7-1da8-4f17-ac2c-1c1b7fb4a88b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:44:19.216545 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bf1d4ac7-1da8-4f17-ac2c-1c1b7fb4a88b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:44:19.223266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf1d4ac7-1da8-4f17-ac2c-1c1b7fb4a88b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:19.223707 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf1d4ac7-1da8-4f17-ac2c-1c1b7fb4a88b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:19.224453 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf1d4ac7-1da8-4f17-ac2c-1c1b7fb4a88b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:19.224882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf1d4ac7-1da8-4f17-ac2c-1c1b7fb4a88b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:19.356313 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bf1d4ac7-1da8-4f17-ac2c-1c1b7fb4a88b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:44:19.363993 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bf1d4ac7-1da8-4f17-ac2c-1c1b7fb4a88b tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1513 microversion: 2.1 time: 0.152544 May 24 13:44:19.364555 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1056/2120] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:44:19 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:44:20.381534 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8335423d-a81c-4d17-9147-d91fe62752d3 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:44:20.382234 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8335423d-a81c-4d17-9147-d91fe62752d3 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:44:20.388812 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8335423d-a81c-4d17-9147-d91fe62752d3 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:20.389259 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8335423d-a81c-4d17-9147-d91fe62752d3 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:20.390024 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8335423d-a81c-4d17-9147-d91fe62752d3 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:20.390498 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8335423d-a81c-4d17-9147-d91fe62752d3 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:20.524817 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8335423d-a81c-4d17-9147-d91fe62752d3 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:44:20.532315 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8335423d-a81c-4d17-9147-d91fe62752d3 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1513 microversion: 2.1 time: 0.155040 May 24 13:44:20.532865 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1065/2121] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:44:20 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:44:21.548897 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b99af229-3ef8-4708-bcb7-fec5b2100319 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:44:21.549628 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b99af229-3ef8-4708-bcb7-fec5b2100319 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:44:21.556100 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b99af229-3ef8-4708-bcb7-fec5b2100319 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:21.556541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b99af229-3ef8-4708-bcb7-fec5b2100319 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:21.557295 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b99af229-3ef8-4708-bcb7-fec5b2100319 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:21.557726 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b99af229-3ef8-4708-bcb7-fec5b2100319 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:21.683460 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b99af229-3ef8-4708-bcb7-fec5b2100319 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a4a93a0cef4b1299b6c520639fed61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae76df6ad404589b0b16ba43d844c48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:44:21.690970 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b99af229-3ef8-4708-bcb7-fec5b2100319 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 200 len: 1513 microversion: 2.1 time: 0.145969 May 24 13:44:21.691529 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1057/2122] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:44:21 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:44:21.939623 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-9566b5fe-690a-4e61-9df5-8c0ffa3937c3 req-94ee5bab-c74a-4e8b-bf3e-32f57a8f3c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6971dd-8ce4-4f35-96f2-1defeea1c81d", "name": "network-vif-deleted", "tag": "1b4f36aa-d350-4bfa-a2d4-ffe83bf9a3d4"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:44:21.951027 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-9566b5fe-690a-4e61-9df5-8c0ffa3937c3 req-94ee5bab-c74a-4e8b-bf3e-32f57a8f3c2e service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:21.951614 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-9566b5fe-690a-4e61-9df5-8c0ffa3937c3 req-94ee5bab-c74a-4e8b-bf3e-32f57a8f3c2e service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:21.965358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-9566b5fe-690a-4e61-9df5-8c0ffa3937c3 req-94ee5bab-c74a-4e8b-bf3e-32f57a8f3c2e service nova] Creating event network-vif-deleted:1b4f36aa-d350-4bfa-a2d4-ffe83bf9a3d4 for instance be6971dd-8ce4-4f35-96f2-1defeea1c81d on hv-cinder-84301 May 24 13:44:21.971340 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-9566b5fe-690a-4e61-9df5-8c0ffa3937c3 req-94ee5bab-c74a-4e8b-bf3e-32f57a8f3c2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035338 May 24 13:44:21.972144 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1066/2123] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:44:22.707643 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:44:22.708166 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] [instance: be6971dd-8ce4-4f35-96f2-1defeea1c81d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:44:22.715763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:22.716206 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:22.716951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:44:22.717377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:44:22.730959 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] HTTP exception thrown: Instance be6971dd-8ce4-4f35-96f2-1defeea1c81d could not be found. May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Request method failure captured: May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d HTTP/1.1 May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept: application/json May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Connection: close May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Host: 10.222.0.45 May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABijOC-AYWbI8229DWox0xxR74RAVt7agWRIdG1yY4BNVxYQhObDpbQFFSQfLtZB4dHRK6Q-KajmezFf55A8M3l92XblBDaiZcYrUFdy6PpUAuodPakLHk3CCscKYquqhF3jdhFALt-G8oVL-mzl2GM97gO_o-rb9gYhXR8nTBN1C3ScrA May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Id: 7ae76df6ad404589b0b16ba43d844c48 May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotTestJSON-936727377 May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 24 13:44:22.732606 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7ae76df6ad404589b0b16ba43d844c48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7ae76df6ad404589b0b16ba43d844c48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7ae76df6ad404589b0b16ba43d844c48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7ae76df6ad404589b0b16ba43d844c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotTestJSON-936727377 May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 7ae76df6ad404589b0b16ba43d844c48 May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-936727377 May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotTestJSON-936727377-project May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Id: 18a4a93a0cef4b1299b6c520639fed61 May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotTestJSON-936727377-project May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: method: > May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: exception: Instance be6971dd-8ce4-4f35-96f2-1defeea1c81d could not be found. May 24 13:44:22.733855 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: action_args: {'id': 'be6971dd-8ce4-4f35-96f2-1defeea1c81d'} May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be6971dd-8ce4-4f35-96f2-1defeea1c81d could not be found. May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:44:22.734594 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be6971dd-8ce4-4f35-96f2-1defeea1c81d could not be found. May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be6971dd-8ce4-4f35-96f2-1defeea1c81d could not be found. May 24 13:44:22.735981 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 24 13:44:22.737262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] Returning 404 to user: Instance be6971dd-8ce4-4f35-96f2-1defeea1c81d could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:44:22.737262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-64de5780-de1f-4d19-ae67-61570bf78109 tempest-VolumesSnapshotTestJSON-936727377 tempest-VolumesSnapshotTestJSON-936727377-project] 10.222.0.45 "GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d" status: 404 len: 111 microversion: 2.1 time: 0.030301 May 24 13:44:22.737262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1058/2124] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:44:22 2022] GET /compute/v2.1/servers/be6971dd-8ce4-4f35-96f2-1defeea1c81d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:44:58.398115 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:44:58.398895 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:44:58.588389 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-877957b0-6f25-439d-a9a2-9345d6a2e6c5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Action: 'create', calling method: .version_select at 0x7f9a6b9a80d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1654106639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6R6vfSmMBXIUVb40r1JKgmfTvyvaYoWRhqIaKiLUrTRocNaCbUazxbok4sZSEfZJG/mnOICKWfM4x4one6HZ4qrhOgvegHjqlmxkpLiWRmu6dvh6n4MKLtttirFfAz6g=="}} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:44:58.603062 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-877957b0-6f25-439d-a9a2-9345d6a2e6c5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Getting quotas for project efbe5203019c46b29f9c9f9bd9287a7d. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:44:58.607280 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.quota [None req-877957b0-6f25-439d-a9a2-9345d6a2e6c5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Getting quotas for user e472fbc8eb174c1b991e6e402396fb56 and project efbe5203019c46b29f9c9f9bd9287a7d. Resources: {'key_pairs'} {{(pid=117643) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:44:58.635994 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-877957b0-6f25-439d-a9a2-9345d6a2e6c5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.242822 May 24 13:44:58.637109 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1067/2125] 10.222.0.45 () {60 vars in 1158 bytes} [Tue May 24 13:44:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:45:00.736535 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:45:00.737120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:45:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:45:00.970412 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:45:00.970560 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:45:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:45:22.124040 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1972632991", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1654106639", "security_groups": [{"name": "tempest-secgroup-smoke-522439655"}], "networks": [{"uuid": "011d96b6-0f8d-4931-9acb-5033d3b1bdca"}], "block_device_mapping_v2": [{"uuid": "69d25741-cf77-4636-b5d7-128408e9e729", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:45:22.132092 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=8 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:45:22.132731 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:45:22.349448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] validate_networks() for [('011d96b6-0f8d-4931-9acb-5033d3b1bdca', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:45:22.798350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:45:22.798785 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:45:22.799266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:45:22.799681 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:45:22.800105 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:45:22.808860 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:22.809307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:22.810104 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:22.810569 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:22.826988 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Getting quotas for project efbe5203019c46b29f9c9f9bd9287a7d. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:45:22.830947 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Getting quotas for user e472fbc8eb174c1b991e6e402396fb56 and project efbe5203019c46b29f9c9f9bd9287a7d. Resources: {'cores', 'ram', 'instances'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:45:22.887580 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:45:22.889601 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69d25741-cf77-4636-b5d7-128408e9e729',volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:45:23.017605 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bf3dfa0c-cdc5-47e5-b33f-b6abc01763bd tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.897269 May 24 13:45:23.018235 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1059/2126] 10.222.0.45 () {60 vars in 1146 bytes} [Tue May 24 13:45:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:45:23.025533 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=4 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:45:23.026686 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:45:23.032450 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-1de5f938-eadc-4d8c-ab17-28c9de2ad7c6 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:23.034167 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-1de5f938-eadc-4d8c-ab17-28c9de2ad7c6 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:23.140724 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-1de5f938-eadc-4d8c-ab17-28c9de2ad7c6 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:23.147446 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-1de5f938-eadc-4d8c-ab17-28c9de2ad7c6 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1089 microversion: 2.1 time: 0.123270 May 24 13:45:23.148014 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1068/2127] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:23 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1089 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:24.164702 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-58aea62d-9ec2-4b6a-a57a-cd196ca6e450 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:24.166371 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-58aea62d-9ec2-4b6a-a57a-cd196ca6e450 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:24.173633 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58aea62d-9ec2-4b6a-a57a-cd196ca6e450 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:24.174088 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58aea62d-9ec2-4b6a-a57a-cd196ca6e450 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:24.174889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58aea62d-9ec2-4b6a-a57a-cd196ca6e450 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:24.175435 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58aea62d-9ec2-4b6a-a57a-cd196ca6e450 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:24.247491 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-58aea62d-9ec2-4b6a-a57a-cd196ca6e450 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:24.255045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-58aea62d-9ec2-4b6a-a57a-cd196ca6e450 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1205 microversion: 2.1 time: 0.094222 May 24 13:45:24.255045 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1060/2128] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:24 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:25.272010 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-e5ee077b-7073-4779-876e-9331cad0215e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:25.272637 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-e5ee077b-7073-4779-876e-9331cad0215e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:25.279972 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e5ee077b-7073-4779-876e-9331cad0215e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:25.280429 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e5ee077b-7073-4779-876e-9331cad0215e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:25.281202 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e5ee077b-7073-4779-876e-9331cad0215e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:25.281644 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-e5ee077b-7073-4779-876e-9331cad0215e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:25.516808 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-e5ee077b-7073-4779-876e-9331cad0215e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:25.526541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-e5ee077b-7073-4779-876e-9331cad0215e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.258207 May 24 13:45:25.527285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1069/2129] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:25 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:25.558889 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-e5233b1b-7628-4374-b82b-9d9c03dedbdd req-66b92d09-6adf-499b-a39e-ed4d92de7f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a1220f-e7c6-49e7-a6e9-109573848614", "tag": "31d0688a-1677-4fe5-8c06-e273f747b655"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:45:25.568266 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-e5233b1b-7628-4374-b82b-9d9c03dedbdd req-66b92d09-6adf-499b-a39e-ed4d92de7f67 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:25.568716 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-e5233b1b-7628-4374-b82b-9d9c03dedbdd req-66b92d09-6adf-499b-a39e-ed4d92de7f67 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:25.581127 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-e5233b1b-7628-4374-b82b-9d9c03dedbdd req-66b92d09-6adf-499b-a39e-ed4d92de7f67 service nova] Creating event network-changed:31d0688a-1677-4fe5-8c06-e273f747b655 for instance 86a1220f-e7c6-49e7-a6e9-109573848614 on hv-cinder-84301 May 24 13:45:25.586141 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-e5233b1b-7628-4374-b82b-9d9c03dedbdd req-66b92d09-6adf-499b-a39e-ed4d92de7f67 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102681 May 24 13:45:25.586779 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1061/2130] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:45:26.545191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a892d943-79c6-4123-9e99-6ac3d059fc93 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:26.545833 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a892d943-79c6-4123-9e99-6ac3d059fc93 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:26.551872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a892d943-79c6-4123-9e99-6ac3d059fc93 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:26.552321 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a892d943-79c6-4123-9e99-6ac3d059fc93 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:26.553075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a892d943-79c6-4123-9e99-6ac3d059fc93 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:26.553508 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a892d943-79c6-4123-9e99-6ac3d059fc93 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:26.679844 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a892d943-79c6-4123-9e99-6ac3d059fc93 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:26.687161 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a892d943-79c6-4123-9e99-6ac3d059fc93 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.146551 May 24 13:45:26.687718 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1070/2131] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:26 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:27.705261 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8c13e444-61e3-4add-95b4-8017a25f5a99 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:27.705967 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8c13e444-61e3-4add-95b4-8017a25f5a99 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:27.712332 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c13e444-61e3-4add-95b4-8017a25f5a99 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:27.712768 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c13e444-61e3-4add-95b4-8017a25f5a99 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:27.713520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c13e444-61e3-4add-95b4-8017a25f5a99 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:27.713952 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c13e444-61e3-4add-95b4-8017a25f5a99 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:27.844149 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8c13e444-61e3-4add-95b4-8017a25f5a99 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:27.851534 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8c13e444-61e3-4add-95b4-8017a25f5a99 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.151474 May 24 13:45:27.852087 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1062/2132] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:27 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:28.868373 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-793231a6-84a4-4158-a4f4-f8675f3ac786 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:28.868987 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-793231a6-84a4-4158-a4f4-f8675f3ac786 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:28.876065 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-793231a6-84a4-4158-a4f4-f8675f3ac786 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:28.876512 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-793231a6-84a4-4158-a4f4-f8675f3ac786 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:28.877261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-793231a6-84a4-4158-a4f4-f8675f3ac786 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:28.877693 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-793231a6-84a4-4158-a4f4-f8675f3ac786 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:29.003564 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-793231a6-84a4-4158-a4f4-f8675f3ac786 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:29.010951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-793231a6-84a4-4158-a4f4-f8675f3ac786 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.146418 May 24 13:45:29.011503 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1071/2133] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:28 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:30.028300 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c040f225-5431-4214-85d0-0f23e569f47d tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:30.028912 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c040f225-5431-4214-85d0-0f23e569f47d tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:30.035432 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c040f225-5431-4214-85d0-0f23e569f47d tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:30.035882 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c040f225-5431-4214-85d0-0f23e569f47d tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:30.036638 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c040f225-5431-4214-85d0-0f23e569f47d tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:30.037070 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c040f225-5431-4214-85d0-0f23e569f47d tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:30.165407 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c040f225-5431-4214-85d0-0f23e569f47d tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:30.173310 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c040f225-5431-4214-85d0-0f23e569f47d tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.148963 May 24 13:45:30.173865 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1063/2134] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:30 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:31.190602 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-ebfd7aec-9833-41e8-a7ac-92850d0086c7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:31.191131 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-ebfd7aec-9833-41e8-a7ac-92850d0086c7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:31.197671 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebfd7aec-9833-41e8-a7ac-92850d0086c7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:31.198122 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebfd7aec-9833-41e8-a7ac-92850d0086c7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:31.198919 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebfd7aec-9833-41e8-a7ac-92850d0086c7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:31.199356 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-ebfd7aec-9833-41e8-a7ac-92850d0086c7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:31.336751 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-ebfd7aec-9833-41e8-a7ac-92850d0086c7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:31.344456 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-ebfd7aec-9833-41e8-a7ac-92850d0086c7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.157851 May 24 13:45:31.345019 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1072/2135] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:31 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:32.360881 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ee89b495-0c71-4b97-a661-381675782045 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:32.361497 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ee89b495-0c71-4b97-a661-381675782045 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:32.367930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee89b495-0c71-4b97-a661-381675782045 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:32.368377 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee89b495-0c71-4b97-a661-381675782045 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:32.369131 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee89b495-0c71-4b97-a661-381675782045 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:32.369565 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee89b495-0c71-4b97-a661-381675782045 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:32.503987 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ee89b495-0c71-4b97-a661-381675782045 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:32.511331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ee89b495-0c71-4b97-a661-381675782045 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.154292 May 24 13:45:32.511870 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1064/2136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:32 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:33.527404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8d6c3546-bc20-4a7c-a1a6-16479d1187f9 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:33.528023 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8d6c3546-bc20-4a7c-a1a6-16479d1187f9 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:33.531055 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell0:SELECT=2 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:45:33.536517 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d6c3546-bc20-4a7c-a1a6-16479d1187f9 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:33.536970 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d6c3546-bc20-4a7c-a1a6-16479d1187f9 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:33.537736 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d6c3546-bc20-4a7c-a1a6-16479d1187f9 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:33.538175 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8d6c3546-bc20-4a7c-a1a6-16479d1187f9 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:33.671358 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8d6c3546-bc20-4a7c-a1a6-16479d1187f9 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:33.678823 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8d6c3546-bc20-4a7c-a1a6-16479d1187f9 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.155242 May 24 13:45:33.679380 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1073/2137] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:33 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:34.695412 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-571ca713-63cc-45ff-b025-7dc10b42a46e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:34.695948 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-571ca713-63cc-45ff-b025-7dc10b42a46e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:34.697886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:45:34.698553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:45:34.704806 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-571ca713-63cc-45ff-b025-7dc10b42a46e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:34.705248 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-571ca713-63cc-45ff-b025-7dc10b42a46e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:34.705998 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-571ca713-63cc-45ff-b025-7dc10b42a46e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:34.706465 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-571ca713-63cc-45ff-b025-7dc10b42a46e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:34.832931 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-571ca713-63cc-45ff-b025-7dc10b42a46e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:34.840592 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-571ca713-63cc-45ff-b025-7dc10b42a46e tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.148868 May 24 13:45:34.841631 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1065/2138] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:34 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:45:35.120615 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-da683059-7d8c-499a-b049-d5f0239bf08c req-70389b9b-08c9-47be-8ad9-c9ce98839257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a1220f-e7c6-49e7-a6e9-109573848614", "name": "network-vif-plugged", "status": "completed", "tag": "31d0688a-1677-4fe5-8c06-e273f747b655"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:45:35.129804 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-da683059-7d8c-499a-b049-d5f0239bf08c req-70389b9b-08c9-47be-8ad9-c9ce98839257 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:35.130249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-da683059-7d8c-499a-b049-d5f0239bf08c req-70389b9b-08c9-47be-8ad9-c9ce98839257 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:35.141448 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-da683059-7d8c-499a-b049-d5f0239bf08c req-70389b9b-08c9-47be-8ad9-c9ce98839257 service nova] Creating event network-vif-plugged:31d0688a-1677-4fe5-8c06-e273f747b655 for instance 86a1220f-e7c6-49e7-a6e9-109573848614 on hv-cinder-84301 May 24 13:45:35.146531 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-da683059-7d8c-499a-b049-d5f0239bf08c req-70389b9b-08c9-47be-8ad9-c9ce98839257 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086670 May 24 13:45:35.147135 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1074/2139] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:45:35.858089 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6625968a-e67e-45ad-a3c2-8ae7981770c8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:35.858733 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6625968a-e67e-45ad-a3c2-8ae7981770c8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:35.865130 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6625968a-e67e-45ad-a3c2-8ae7981770c8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:35.865570 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6625968a-e67e-45ad-a3c2-8ae7981770c8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:35.866335 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6625968a-e67e-45ad-a3c2-8ae7981770c8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:35.866768 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6625968a-e67e-45ad-a3c2-8ae7981770c8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:36.003898 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6625968a-e67e-45ad-a3c2-8ae7981770c8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:36.011456 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6625968a-e67e-45ad-a3c2-8ae7981770c8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1260 microversion: 2.1 time: 0.157806 May 24 13:45:36.012023 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1066/2140] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:35 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:37.028545 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-a6e49e88-c35b-41b6-a861-c1fbafc82124 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:37.029249 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-a6e49e88-c35b-41b6-a861-c1fbafc82124 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:37.035455 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6e49e88-c35b-41b6-a861-c1fbafc82124 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:37.035906 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6e49e88-c35b-41b6-a861-c1fbafc82124 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:37.036670 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6e49e88-c35b-41b6-a861-c1fbafc82124 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:37.037110 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-a6e49e88-c35b-41b6-a861-c1fbafc82124 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:37.164879 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-a6e49e88-c35b-41b6-a861-c1fbafc82124 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:37.172903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-a6e49e88-c35b-41b6-a861-c1fbafc82124 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1443 microversion: 2.1 time: 0.149216 May 24 13:45:37.173473 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1075/2141] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:37 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:37.188541 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dacfd295-4dee-4e51-8228-668a29cee5cb tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:45:37.189156 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dacfd295-4dee-4e51-8228-668a29cee5cb tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:45:37.195598 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dacfd295-4dee-4e51-8228-668a29cee5cb tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:37.196041 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dacfd295-4dee-4e51-8228-668a29cee5cb tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:37.196786 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dacfd295-4dee-4e51-8228-668a29cee5cb tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:37.197218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dacfd295-4dee-4e51-8228-668a29cee5cb tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:37.323081 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dacfd295-4dee-4e51-8228-668a29cee5cb tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:45:37.330563 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dacfd295-4dee-4e51-8228-668a29cee5cb tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1443 microversion: 2.1 time: 0.145851 May 24 13:45:37.331142 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1067/2142] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:45:37 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1443 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:45:39.220362 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-ca1e220e-09d0-402f-a1aa-674abe4e014c req-be68c86a-e2f2-4e27-80ba-05497eedd599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a1220f-e7c6-49e7-a6e9-109573848614", "tag": "31d0688a-1677-4fe5-8c06-e273f747b655"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:45:39.228411 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-ca1e220e-09d0-402f-a1aa-674abe4e014c req-be68c86a-e2f2-4e27-80ba-05497eedd599 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:45:39.228856 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-ca1e220e-09d0-402f-a1aa-674abe4e014c req-be68c86a-e2f2-4e27-80ba-05497eedd599 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:45:39.239933 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-ca1e220e-09d0-402f-a1aa-674abe4e014c req-be68c86a-e2f2-4e27-80ba-05497eedd599 service nova] Creating event network-changed:31d0688a-1677-4fe5-8c06-e273f747b655 for instance 86a1220f-e7c6-49e7-a6e9-109573848614 on hv-cinder-84301 May 24 13:45:39.245059 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-ca1e220e-09d0-402f-a1aa-674abe4e014c req-be68c86a-e2f2-4e27-80ba-05497eedd599 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084078 May 24 13:45:39.245742 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1076/2143] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:47:00.057689 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:47:00.058250 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:47:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:47:53.088876 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:53.089621 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=46 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:53.094562 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-00647cc6-285e-4c44-82e8-775f5755643a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:47:53.095153 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-00647cc6-285e-4c44-82e8-775f5755643a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:47:53.102892 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00647cc6-285e-4c44-82e8-775f5755643a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:53.103345 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00647cc6-285e-4c44-82e8-775f5755643a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:53.104102 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00647cc6-285e-4c44-82e8-775f5755643a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:53.104588 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00647cc6-285e-4c44-82e8-775f5755643a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:53.137901 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-00647cc6-285e-4c44-82e8-775f5755643a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lazy-loading 'flavor' on Instance uuid 86a1220f-e7c6-49e7-a6e9-109573848614 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:47:53.209754 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-00647cc6-285e-4c44-82e8-775f5755643a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "POST /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614/action" status: 202 len: 0 microversion: 2.1 time: 0.122445 May 24 13:47:53.210556 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1068/2144] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:47:53 2022] POST /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:47:53.218734 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1edc446e-99a8-47f5-83a1-692a07eca1d0] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 24 13:47:53.219350 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=20 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:53.220274 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=40 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:53.225262 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b0e1b9e9-494e-4dfb-8cef-fc2ec9d767ce tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:53.226207 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b0e1b9e9-494e-4dfb-8cef-fc2ec9d767ce tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:47:53.235630 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0e1b9e9-494e-4dfb-8cef-fc2ec9d767ce tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:53.236596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0e1b9e9-494e-4dfb-8cef-fc2ec9d767ce tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:53.237355 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0e1b9e9-494e-4dfb-8cef-fc2ec9d767ce tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:53.237786 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b0e1b9e9-494e-4dfb-8cef-fc2ec9d767ce tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:53.368113 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b0e1b9e9-494e-4dfb-8cef-fc2ec9d767ce tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:47:53.375620 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b0e1b9e9-494e-4dfb-8cef-fc2ec9d767ce tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.160194 May 24 13:47:53.376182 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1077/2145] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:47:53 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:47:54.394451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-52a2d752-e615-4b06-848d-97dfe10540d4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:54.395151 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-52a2d752-e615-4b06-848d-97dfe10540d4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:47:54.402331 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52a2d752-e615-4b06-848d-97dfe10540d4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:54.402782 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52a2d752-e615-4b06-848d-97dfe10540d4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:54.403544 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52a2d752-e615-4b06-848d-97dfe10540d4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:54.403972 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52a2d752-e615-4b06-848d-97dfe10540d4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:54.552120 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-52a2d752-e615-4b06-848d-97dfe10540d4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:47:54.559660 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-52a2d752-e615-4b06-848d-97dfe10540d4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.170218 May 24 13:47:54.560218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1069/2146] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:47:54 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:47:55.577322 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-0d5c919a-dfcf-41a2-a3b0-6a05cb209b91 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:55.577944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-0d5c919a-dfcf-41a2-a3b0-6a05cb209b91 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:47:55.585158 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d5c919a-dfcf-41a2-a3b0-6a05cb209b91 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:55.585619 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d5c919a-dfcf-41a2-a3b0-6a05cb209b91 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:55.586413 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d5c919a-dfcf-41a2-a3b0-6a05cb209b91 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:55.586860 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-0d5c919a-dfcf-41a2-a3b0-6a05cb209b91 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:55.592938 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] [1edc446e-99a8-47f5-83a1-692a07eca1d0] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45858. May 24 13:47:55.723121 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-0d5c919a-dfcf-41a2-a3b0-6a05cb209b91 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:47:55.730648 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-0d5c919a-dfcf-41a2-a3b0-6a05cb209b91 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.157216 May 24 13:47:55.731209 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1078/2147] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:47:55 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:47:56.747448 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-96103579-4fe0-4eca-8003-0f375144d0e8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:56.747976 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-96103579-4fe0-4eca-8003-0f375144d0e8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:47:56.754817 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96103579-4fe0-4eca-8003-0f375144d0e8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:56.755262 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96103579-4fe0-4eca-8003-0f375144d0e8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:56.756007 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96103579-4fe0-4eca-8003-0f375144d0e8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:56.756436 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-96103579-4fe0-4eca-8003-0f375144d0e8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:56.891375 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-96103579-4fe0-4eca-8003-0f375144d0e8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:47:56.898692 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-96103579-4fe0-4eca-8003-0f375144d0e8 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.155106 May 24 13:47:56.899245 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1070/2148] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:47:56 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:47:57.915564 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-13ba731d-73f0-4262-bb87-d85d027f87ff tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:57.916185 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-13ba731d-73f0-4262-bb87-d85d027f87ff tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:47:57.922716 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-13ba731d-73f0-4262-bb87-d85d027f87ff tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:57.923174 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-13ba731d-73f0-4262-bb87-d85d027f87ff tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:57.923939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-13ba731d-73f0-4262-bb87-d85d027f87ff tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:57.924378 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-13ba731d-73f0-4262-bb87-d85d027f87ff tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:58.049491 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-13ba731d-73f0-4262-bb87-d85d027f87ff tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:47:58.057026 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-13ba731d-73f0-4262-bb87-d85d027f87ff tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.145403 May 24 13:47:58.057593 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1079/2149] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:47:57 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:47:59.074311 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fc0fdd66-322f-4ec6-b41f-16e0cc20903f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:59.074863 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fc0fdd66-322f-4ec6-b41f-16e0cc20903f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:47:59.081254 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fc0fdd66-322f-4ec6-b41f-16e0cc20903f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:59.081703 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fc0fdd66-322f-4ec6-b41f-16e0cc20903f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:59.082484 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fc0fdd66-322f-4ec6-b41f-16e0cc20903f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:47:59.082917 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fc0fdd66-322f-4ec6-b41f-16e0cc20903f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:47:59.210818 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fc0fdd66-322f-4ec6-b41f-16e0cc20903f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:47:59.218991 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fc0fdd66-322f-4ec6-b41f-16e0cc20903f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.148602 May 24 13:47:59.219553 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1071/2150] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:47:59 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:00.235435 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-57904299-91c6-4f69-9655-73960aa380a7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:00.236596 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-57904299-91c6-4f69-9655-73960aa380a7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:00.243139 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57904299-91c6-4f69-9655-73960aa380a7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:00.243593 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57904299-91c6-4f69-9655-73960aa380a7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:00.244521 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57904299-91c6-4f69-9655-73960aa380a7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:00.244965 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-57904299-91c6-4f69-9655-73960aa380a7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:00.375946 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-57904299-91c6-4f69-9655-73960aa380a7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:00.383528 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-57904299-91c6-4f69-9655-73960aa380a7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.151965 May 24 13:48:00.384092 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1080/2151] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:00 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:01.400271 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-082997af-86ba-4fb1-92c5-e70bfe079dea tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:01.400885 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-082997af-86ba-4fb1-92c5-e70bfe079dea tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:01.407492 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-082997af-86ba-4fb1-92c5-e70bfe079dea tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:01.407951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-082997af-86ba-4fb1-92c5-e70bfe079dea tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:01.408714 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-082997af-86ba-4fb1-92c5-e70bfe079dea tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:01.409147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-082997af-86ba-4fb1-92c5-e70bfe079dea tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:01.541443 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-082997af-86ba-4fb1-92c5-e70bfe079dea tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:01.549471 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-082997af-86ba-4fb1-92c5-e70bfe079dea tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.153049 May 24 13:48:01.550028 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1072/2152] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:01 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:02.566795 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-7faa9eef-fdb4-4970-b12d-d65cc9766184 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:02.567408 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-7faa9eef-fdb4-4970-b12d-d65cc9766184 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:02.573825 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7faa9eef-fdb4-4970-b12d-d65cc9766184 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:02.574269 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7faa9eef-fdb4-4970-b12d-d65cc9766184 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:02.575048 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7faa9eef-fdb4-4970-b12d-d65cc9766184 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:02.575479 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-7faa9eef-fdb4-4970-b12d-d65cc9766184 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:02.700951 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-7faa9eef-fdb4-4970-b12d-d65cc9766184 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:02.708903 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-7faa9eef-fdb4-4970-b12d-d65cc9766184 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.146526 May 24 13:48:02.709462 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1081/2153] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:02 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:03.726221 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-058d9629-86d8-49b5-bcbf-b75b44354b3b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:03.726875 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-058d9629-86d8-49b5-bcbf-b75b44354b3b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:03.733951 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-058d9629-86d8-49b5-bcbf-b75b44354b3b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:03.734443 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-058d9629-86d8-49b5-bcbf-b75b44354b3b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:03.735218 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-058d9629-86d8-49b5-bcbf-b75b44354b3b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:03.735662 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-058d9629-86d8-49b5-bcbf-b75b44354b3b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:03.865848 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-058d9629-86d8-49b5-bcbf-b75b44354b3b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:03.874653 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-058d9629-86d8-49b5-bcbf-b75b44354b3b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.152321 May 24 13:48:03.875295 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1073/2154] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:03 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:04.892360 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-97d2f412-b4fe-443b-b650-3428e0c94908 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:04.893005 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-97d2f412-b4fe-443b-b650-3428e0c94908 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:04.899647 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97d2f412-b4fe-443b-b650-3428e0c94908 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:04.900100 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97d2f412-b4fe-443b-b650-3428e0c94908 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:04.900864 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97d2f412-b4fe-443b-b650-3428e0c94908 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:04.901303 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-97d2f412-b4fe-443b-b650-3428e0c94908 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:05.034097 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-97d2f412-b4fe-443b-b650-3428e0c94908 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:05.041872 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-97d2f412-b4fe-443b-b650-3428e0c94908 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.153432 May 24 13:48:05.042482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1082/2155] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:04 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:06.059174 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-09eb6291-5667-4a27-a761-f3d51227655b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:06.059698 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-09eb6291-5667-4a27-a761-f3d51227655b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:06.066216 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09eb6291-5667-4a27-a761-f3d51227655b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:06.067016 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09eb6291-5667-4a27-a761-f3d51227655b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:06.067781 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09eb6291-5667-4a27-a761-f3d51227655b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:06.068223 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09eb6291-5667-4a27-a761-f3d51227655b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:06.208895 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-09eb6291-5667-4a27-a761-f3d51227655b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:06.216962 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-09eb6291-5667-4a27-a761-f3d51227655b tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1569 microversion: 2.1 time: 0.161406 May 24 13:48:06.217532 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1074/2156] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:06 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:06.232737 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8e2a4e39-2545-4918-b516-74c6adca5f01 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:06.233314 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8e2a4e39-2545-4918-b516-74c6adca5f01 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:06.240034 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8e2a4e39-2545-4918-b516-74c6adca5f01 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:06.240482 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8e2a4e39-2545-4918-b516-74c6adca5f01 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:06.241275 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8e2a4e39-2545-4918-b516-74c6adca5f01 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:06.241710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8e2a4e39-2545-4918-b516-74c6adca5f01 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:06.379592 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8e2a4e39-2545-4918-b516-74c6adca5f01 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "POST /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614/action" status: 202 len: 0 microversion: 2.1 time: 0.150653 May 24 13:48:06.380194 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1083/2157] 10.222.0.45 () {60 vars in 1277 bytes} [Tue May 24 13:48:06 2022] POST /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:48:06.388121 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d2881a5-49fa-4b12-827f-6e794327a429 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:06.388736 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d2881a5-49fa-4b12-827f-6e794327a429 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:06.395410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d2881a5-49fa-4b12-827f-6e794327a429 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:06.395857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d2881a5-49fa-4b12-827f-6e794327a429 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:06.396650 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d2881a5-49fa-4b12-827f-6e794327a429 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:06.397079 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d2881a5-49fa-4b12-827f-6e794327a429 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:06.578891 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d2881a5-49fa-4b12-827f-6e794327a429 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:06.586422 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d2881a5-49fa-4b12-827f-6e794327a429 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1517 microversion: 2.1 time: 0.202114 May 24 13:48:06.586995 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1075/2158] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:06 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:48:07.603522 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b9b2f456-4429-4543-8ac9-8739a4634293 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:07.604170 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b9b2f456-4429-4543-8ac9-8739a4634293 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:07.610311 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b9b2f456-4429-4543-8ac9-8739a4634293 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:07.610782 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b9b2f456-4429-4543-8ac9-8739a4634293 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:07.611541 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b9b2f456-4429-4543-8ac9-8739a4634293 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:07.611978 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b9b2f456-4429-4543-8ac9-8739a4634293 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:07.741345 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b9b2f456-4429-4543-8ac9-8739a4634293 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:07.749870 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b9b2f456-4429-4543-8ac9-8739a4634293 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1575 microversion: 2.1 time: 0.150632 May 24 13:48:07.750464 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1084/2159] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:07 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:07.907546 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-5dba5324-46a9-43ec-a4cd-c9d1b125272a req-23dcb6d3-0d4f-46ce-9ad9-673125f99be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a1220f-e7c6-49e7-a6e9-109573848614", "name": "network-vif-unplugged", "status": "completed", "tag": "31d0688a-1677-4fe5-8c06-e273f747b655"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:07.919923 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5dba5324-46a9-43ec-a4cd-c9d1b125272a req-23dcb6d3-0d4f-46ce-9ad9-673125f99be8 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:07.920457 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5dba5324-46a9-43ec-a4cd-c9d1b125272a req-23dcb6d3-0d4f-46ce-9ad9-673125f99be8 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:07.933034 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-5dba5324-46a9-43ec-a4cd-c9d1b125272a req-23dcb6d3-0d4f-46ce-9ad9-673125f99be8 service nova] Creating event network-vif-unplugged:31d0688a-1677-4fe5-8c06-e273f747b655 for instance 86a1220f-e7c6-49e7-a6e9-109573848614 on hv-cinder-84301 May 24 13:48:07.938441 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-5dba5324-46a9-43ec-a4cd-c9d1b125272a req-23dcb6d3-0d4f-46ce-9ad9-673125f99be8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034695 May 24 13:48:07.939941 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1076/2160] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:48:08.768404 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-751100e3-c587-46c4-b622-0ef6af577dad tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:08.768920 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-751100e3-c587-46c4-b622-0ef6af577dad tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:08.775748 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-751100e3-c587-46c4-b622-0ef6af577dad tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:08.776191 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-751100e3-c587-46c4-b622-0ef6af577dad tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:08.776940 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-751100e3-c587-46c4-b622-0ef6af577dad tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:08.777374 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-751100e3-c587-46c4-b622-0ef6af577dad tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:08.911183 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-751100e3-c587-46c4-b622-0ef6af577dad tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:08.918595 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-751100e3-c587-46c4-b622-0ef6af577dad tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1575 microversion: 2.1 time: 0.154631 May 24 13:48:08.919151 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1085/2161] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:08 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:09.936323 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8be9afcb-dedd-4e60-9bf6-cf1b747ac0d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:09.937015 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8be9afcb-dedd-4e60-9bf6-cf1b747ac0d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:09.943780 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8be9afcb-dedd-4e60-9bf6-cf1b747ac0d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:09.944224 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8be9afcb-dedd-4e60-9bf6-cf1b747ac0d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:09.945307 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8be9afcb-dedd-4e60-9bf6-cf1b747ac0d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:09.945743 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8be9afcb-dedd-4e60-9bf6-cf1b747ac0d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:10.076126 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8be9afcb-dedd-4e60-9bf6-cf1b747ac0d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:10.084030 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8be9afcb-dedd-4e60-9bf6-cf1b747ac0d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1575 microversion: 2.1 time: 0.152368 May 24 13:48:10.084589 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1077/2162] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:09 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:11.100871 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-961690cc-b7a3-4594-9fbe-b152228439d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:11.101499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-961690cc-b7a3-4594-9fbe-b152228439d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:11.108075 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-961690cc-b7a3-4594-9fbe-b152228439d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:11.108527 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-961690cc-b7a3-4594-9fbe-b152228439d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:11.109289 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-961690cc-b7a3-4594-9fbe-b152228439d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:11.109760 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-961690cc-b7a3-4594-9fbe-b152228439d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:11.235204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-961690cc-b7a3-4594-9fbe-b152228439d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:11.243261 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-961690cc-b7a3-4594-9fbe-b152228439d5 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1575 microversion: 2.1 time: 0.146294 May 24 13:48:11.243824 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1086/2163] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:11 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:12.260568 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-096196b5-205f-4853-b1b6-cdb367d3775a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:12.261178 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-096196b5-205f-4853-b1b6-cdb367d3775a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:12.268263 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-096196b5-205f-4853-b1b6-cdb367d3775a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:12.268705 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-096196b5-205f-4853-b1b6-cdb367d3775a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:12.269451 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-096196b5-205f-4853-b1b6-cdb367d3775a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:12.269893 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-096196b5-205f-4853-b1b6-cdb367d3775a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:12.399269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-096196b5-205f-4853-b1b6-cdb367d3775a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:12.406701 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-096196b5-205f-4853-b1b6-cdb367d3775a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1575 microversion: 2.1 time: 0.149926 May 24 13:48:12.407214 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1078/2164] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:12 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:13.423547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-11899223-99cf-49d5-94fe-e16bf655ef5a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:13.424169 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-11899223-99cf-49d5-94fe-e16bf655ef5a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:13.430712 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11899223-99cf-49d5-94fe-e16bf655ef5a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:13.431177 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11899223-99cf-49d5-94fe-e16bf655ef5a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:13.431944 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11899223-99cf-49d5-94fe-e16bf655ef5a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:13.432385 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-11899223-99cf-49d5-94fe-e16bf655ef5a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:13.562082 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-11899223-99cf-49d5-94fe-e16bf655ef5a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:13.569593 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-11899223-99cf-49d5-94fe-e16bf655ef5a tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1575 microversion: 2.1 time: 0.150032 May 24 13:48:13.570159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1087/2165] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:13 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:14.586956 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9521331a-3710-48bc-a7fb-951680e6c6ae tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:14.587571 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9521331a-3710-48bc-a7fb-951680e6c6ae tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:14.594504 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9521331a-3710-48bc-a7fb-951680e6c6ae tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:14.594958 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9521331a-3710-48bc-a7fb-951680e6c6ae tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:14.595718 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9521331a-3710-48bc-a7fb-951680e6c6ae tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:14.596159 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9521331a-3710-48bc-a7fb-951680e6c6ae tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:14.722798 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9521331a-3710-48bc-a7fb-951680e6c6ae tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:14.730258 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9521331a-3710-48bc-a7fb-951680e6c6ae tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1575 microversion: 2.1 time: 0.147188 May 24 13:48:14.731005 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1079/2166] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:14 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:15.747863 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-8956621d-3423-48a0-874c-31068ecfbd4c tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:15.748499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-8956621d-3423-48a0-874c-31068ecfbd4c tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:15.755710 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8956621d-3423-48a0-874c-31068ecfbd4c tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:15.756154 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8956621d-3423-48a0-874c-31068ecfbd4c tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:15.756908 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8956621d-3423-48a0-874c-31068ecfbd4c tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:15.757339 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-8956621d-3423-48a0-874c-31068ecfbd4c tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:15.885783 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-8956621d-3423-48a0-874c-31068ecfbd4c tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:15.893281 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-8956621d-3423-48a0-874c-31068ecfbd4c tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1575 microversion: 2.1 time: 0.149253 May 24 13:48:15.893846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1088/2167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:15 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:16.910641 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5636db91-eab4-4e8e-9975-8ea50f1631d7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:16.911269 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5636db91-eab4-4e8e-9975-8ea50f1631d7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:48:16.918171 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5636db91-eab4-4e8e-9975-8ea50f1631d7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:16.918665 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5636db91-eab4-4e8e-9975-8ea50f1631d7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:16.919574 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5636db91-eab4-4e8e-9975-8ea50f1631d7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:16.920029 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5636db91-eab4-4e8e-9975-8ea50f1631d7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:17.054161 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5636db91-eab4-4e8e-9975-8ea50f1631d7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:48:17.061755 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5636db91-eab4-4e8e-9975-8ea50f1631d7 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1562 microversion: 2.1 time: 0.155591 May 24 13:48:17.062337 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1080/2168] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:48:16 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:18.386181 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-7434eb77-447d-4ca7-9cf6-54cb8cff6a70 req-e129f114-8a0e-400f-87b4-a1716da9db80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a1220f-e7c6-49e7-a6e9-109573848614", "name": "network-vif-plugged", "status": "completed", "tag": "31d0688a-1677-4fe5-8c06-e273f747b655"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:18.395204 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-7434eb77-447d-4ca7-9cf6-54cb8cff6a70 req-e129f114-8a0e-400f-87b4-a1716da9db80 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:48:18.395656 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-7434eb77-447d-4ca7-9cf6-54cb8cff6a70 req-e129f114-8a0e-400f-87b4-a1716da9db80 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:48:18.407991 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-7434eb77-447d-4ca7-9cf6-54cb8cff6a70 req-e129f114-8a0e-400f-87b4-a1716da9db80 service nova] Creating event network-vif-plugged:31d0688a-1677-4fe5-8c06-e273f747b655 for instance 86a1220f-e7c6-49e7-a6e9-109573848614 on hv-cinder-84301 May 24 13:48:18.411645 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR oslo.messaging._drivers.impl_rabbit [req-7434eb77-447d-4ca7-9cf6-54cb8cff6a70 req-e129f114-8a0e-400f-87b4-a1716da9db80 service nova] [aa2f6979-d41b-4703-ab67-bb22b533748b] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 13:48:19.418085 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [req-7434eb77-447d-4ca7-9cf6-54cb8cff6a70 req-e129f114-8a0e-400f-87b4-a1716da9db80 service nova] [aa2f6979-d41b-4703-ab67-bb22b533748b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45928. May 24 13:48:19.421547 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-7434eb77-447d-4ca7-9cf6-54cb8cff6a70 req-e129f114-8a0e-400f-87b4-a1716da9db80 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.039253 May 24 13:48:19.422180 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1089/2169] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:20.744911 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:48:20.745464 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:48:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:48:20.980350 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:48:20.980550 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:48:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:49:44.748886 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=26 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:49:44.750554 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:49:44.752329 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_api:SELECT=28 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:49:44.753254 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG dbcounter [-] [117643] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:49:44.757803 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1d984958-4d54-498b-9001-d6897ab91cc4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:44.758661 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1d984958-4d54-498b-9001-d6897ab91cc4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:49:44.758789 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-d1a86515-a754-470a-88a2-9bff866d24ee req-dd06de9e-3734-48a5-af9d-acc7b1f56593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a1220f-e7c6-49e7-a6e9-109573848614", "tag": "31d0688a-1677-4fe5-8c06-e273f747b655"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:49:44.766966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d984958-4d54-498b-9001-d6897ab91cc4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:44.767506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d984958-4d54-498b-9001-d6897ab91cc4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:44.768494 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d984958-4d54-498b-9001-d6897ab91cc4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:44.768619 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-d1a86515-a754-470a-88a2-9bff866d24ee req-dd06de9e-3734-48a5-af9d-acc7b1f56593 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:44.768943 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-d1a86515-a754-470a-88a2-9bff866d24ee req-dd06de9e-3734-48a5-af9d-acc7b1f56593 service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:44.769173 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d984958-4d54-498b-9001-d6897ab91cc4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:44.780440 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-d1a86515-a754-470a-88a2-9bff866d24ee req-dd06de9e-3734-48a5-af9d-acc7b1f56593 service nova] Creating event network-changed:31d0688a-1677-4fe5-8c06-e273f747b655 for instance 86a1220f-e7c6-49e7-a6e9-109573848614 on hv-cinder-84301 May 24 13:49:44.786011 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-d1a86515-a754-470a-88a2-9bff866d24ee req-dd06de9e-3734-48a5-af9d-acc7b1f56593 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036134 May 24 13:49:44.786882 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1090/2170] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:49:44.797234 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1d984958-4d54-498b-9001-d6897ab91cc4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:49:44.889386 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1d984958-4d54-498b-9001-d6897ab91cc4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "DELETE /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 204 len: 0 microversion: 2.1 time: 0.141654 May 24 13:49:44.890309 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1081/2171] 10.222.0.45 () {58 vars in 1238 bytes} [Tue May 24 13:49:44 2022] DELETE /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:49:44.903063 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-b136b702-a02b-4bd6-b3a3-6f252331a8b2 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:44.903773 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-b136b702-a02b-4bd6-b3a3-6f252331a8b2 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:49:44.910000 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b136b702-a02b-4bd6-b3a3-6f252331a8b2 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:44.910483 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b136b702-a02b-4bd6-b3a3-6f252331a8b2 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:44.911251 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b136b702-a02b-4bd6-b3a3-6f252331a8b2 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:44.911687 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-b136b702-a02b-4bd6-b3a3-6f252331a8b2 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:45.070625 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.policy [None req-b136b702-a02b-4bd6-b3a3-6f252331a8b2 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117643) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:49:45.078245 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-b136b702-a02b-4bd6-b3a3-6f252331a8b2 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.180284 May 24 13:49:45.078849 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1091/2172] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:49:44 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:49:46.096455 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5639eb9d-1e01-493c-b0b0-b56eaf33a66f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:46.097200 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5639eb9d-1e01-493c-b0b0-b56eaf33a66f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:49:46.103709 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5639eb9d-1e01-493c-b0b0-b56eaf33a66f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:46.104158 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5639eb9d-1e01-493c-b0b0-b56eaf33a66f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:46.104921 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5639eb9d-1e01-493c-b0b0-b56eaf33a66f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:46.105351 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5639eb9d-1e01-493c-b0b0-b56eaf33a66f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:46.237459 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5639eb9d-1e01-493c-b0b0-b56eaf33a66f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:49:46.244857 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5639eb9d-1e01-493c-b0b0-b56eaf33a66f tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1568 microversion: 2.1 time: 0.152995 May 24 13:49:46.245410 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1082/2173] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:49:46 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:49:46.977285 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [req-1eeaea5e-b39d-444c-aaf2-741cb508f1e5 req-ec383150-e33a-4d4d-a60a-ef52d58ea82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a1220f-e7c6-49e7-a6e9-109573848614", "name": "network-vif-deleted", "tag": "31d0688a-1677-4fe5-8c06-e273f747b655"}]} {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:49:46.987772 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-1eeaea5e-b39d-444c-aaf2-741cb508f1e5 req-ec383150-e33a-4d4d-a60a-ef52d58ea82c service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:46.988228 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [req-1eeaea5e-b39d-444c-aaf2-741cb508f1e5 req-ec383150-e33a-4d4d-a60a-ef52d58ea82c service nova] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:47.000939 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.compute.server_external_events [req-1eeaea5e-b39d-444c-aaf2-741cb508f1e5 req-ec383150-e33a-4d4d-a60a-ef52d58ea82c service nova] Creating event network-vif-deleted:31d0688a-1677-4fe5-8c06-e273f747b655 for instance 86a1220f-e7c6-49e7-a6e9-109573848614 on hv-cinder-84301 May 24 13:49:47.006091 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [req-1eeaea5e-b39d-444c-aaf2-741cb508f1e5 req-ec383150-e33a-4d4d-a60a-ef52d58ea82c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032589 May 24 13:49:47.006711 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1092/2174] 10.222.0.45 () {64 vars in 1317 bytes} [Tue May 24 13:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:49:47.261506 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0a005f2b-e279-4d92-8307-ef70becbf6f4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:47.262157 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0a005f2b-e279-4d92-8307-ef70becbf6f4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:49:47.268930 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a005f2b-e279-4d92-8307-ef70becbf6f4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:47.269380 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a005f2b-e279-4d92-8307-ef70becbf6f4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:47.270147 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a005f2b-e279-4d92-8307-ef70becbf6f4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:47.270796 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a005f2b-e279-4d92-8307-ef70becbf6f4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:47.347795 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0a005f2b-e279-4d92-8307-ef70becbf6f4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e472fbc8eb174c1b991e6e402396fb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe5203019c46b29f9c9f9bd9287a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:49:47.355919 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0a005f2b-e279-4d92-8307-ef70becbf6f4 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 200 len: 1220 microversion: 2.1 time: 0.098762 May 24 13:49:47.365717 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1083/2175] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:49:47 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:49:48.373766 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '>' {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:48.374504 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.compute.api [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] [instance: 86a1220f-e7c6-49e7-a6e9-109573848614] Fetching instance by UUID {{(pid=117643) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:49:48.380809 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:48.381264 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:48.382030 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:49:48.382499 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG oslo_concurrency.lockutils [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Lock "de0c2428-d0d8-4818-ae79-653b75265d0b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:49:48.395846 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.wsgi [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] HTTP exception thrown: Instance 86a1220f-e7c6-49e7-a6e9-109573848614 could not be found. May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Request method failure captured: May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: request: GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 HTTP/1.1 May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept: application/json May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Accept-Encoding: identity May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Connection: close May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Length: 0 May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Content-Type: application/json May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Host: 10.222.0.45 May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Openstack-System-Scope: None May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: User-Agent: python-urllib3/1.26.9 May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Auth-Token: gAAAAABijOFVVNdFBqsUnLGJTMQZrwryld5JR_XTs1wpZcTs3Yf8KFETMOrRy_ANXzSeLjpIUjoJLMPnywCM3HdxdCNEu4qd2nkXCbt0A4pU_ehb3fUDEtw-sOKslkdRpPM9TVAwnHRRRteJGjJcuG6GT8vUfY-Yz8KyxbsUv75YGX82SF8sByY May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Id: None May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Domain-Name: None May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Identity-Status: Confirmed May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Is-Admin-Project: True May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Id: default May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Domain-Name: Default May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Id: efbe5203019c46b29f9c9f9bd9287a7d May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Project-Name: tempest-TestShelveInstance-364084699 May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Role: member,reader May 24 13:49:48.397506 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Roles: member,reader May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efbe5203019c46b29f9c9f9bd9287a7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/efbe5203019c46b29f9c9f9bd9287a7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_efbe5203019c46b29f9c9f9bd9287a7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efbe5203019c46b29f9c9f9bd9287a7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant: tempest-TestShelveInstance-364084699 May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Id: efbe5203019c46b29f9c9f9bd9287a7d May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-Tenant-Name: tempest-TestShelveInstance-364084699 May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User: tempest-TestShelveInstance-364084699-project May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Id: default May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Domain-Name: Default May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Id: e472fbc8eb174c1b991e6e402396fb56 May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: X-User-Name: tempest-TestShelveInstance-364084699-project May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: method: > May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: exception: Instance 86a1220f-e7c6-49e7-a6e9-109573848614 could not be found. May 24 13:49:48.399295 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: action_args: {'id': '86a1220f-e7c6-49e7-a6e9-109573848614'} May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: {{(pid=117643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a1220f-e7c6-49e7-a6e9-109573848614 could not be found. May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:49:48.400006 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a1220f-e7c6-49e7-a6e9-109573848614 could not be found. May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a1220f-e7c6-49e7-a6e9-109573848614 could not be found. May 24 13:49:48.401441 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: ERROR nova.api.openstack.wsgi May 24 13:49:48.402675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: DEBUG nova.api.openstack.wsgi [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Returning 404 to user: Instance 86a1220f-e7c6-49e7-a6e9-109573848614 could not be found. {{(pid=117643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:49:48.402675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO nova.api.openstack.requestlog [None req-026ba130-f816-403d-88af-9734ea49d8ab tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614" status: 404 len: 111 microversion: 2.1 time: 0.030351 May 24 13:49:48.402675 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: [pid: 117643|app: 0|req: 1093/2176] 10.222.0.45 () {58 vars in 1235 bytes} [Tue May 24 13:49:48 2022] GET /compute/v2.1/servers/86a1220f-e7c6-49e7-a6e9-109573848614 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:49:48.561193 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6e0dc40e-9e6a-46ca-aaa1-a900c7e65219 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] Calling method '.version_select at 0x7f9a6707e4c0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:48.584636 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6e0dc40e-9e6a-46ca-aaa1-a900c7e65219 tempest-TestShelveInstance-364084699 tempest-TestShelveInstance-364084699-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1654106639" status: 202 len: 0 microversion: 2.1 time: 0.027178 May 24 13:49:48.585520 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1084/2177] 10.222.0.45 () {58 vars in 1253 bytes} [Tue May 24 13:49:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1654106639 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:50:10.326546 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:50:10.327159 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:50:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:51:40.988368 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:51:40.988966 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:52:27.844084 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:52:27.844763 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:53:30.335578 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:53:30.336078 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:53:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:53:40.069155 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:53:40.069769 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:53:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:55:00.755655 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:55:00.756255 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:55:00.996146 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:55:00.996341 dv-cinder-843018-2-iscsi devstack@n-api.service[117642]: Tue May 24 13:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:55:23.760731 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:55:23.761321 dv-cinder-843018-2-iscsi devstack@n-api.service[117643]: Tue May 24 13:55:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!